Большое практическое задание 2

Классификация заемщиков линейными моделями

курс "Машинное обучение 1", программа AIMasters, 2022

Студент: Александров Богдан Георгиевич

Формулировка задания

Данное задание направлено на ознакомление с линейными моделями и градиентными методами обучения. В задании необходимо:

1. Написать на языке Python собственную реализацию линейного классификатора с произвольной функцией потерь и реализацию функции и градиента функции потерь для логистической регрессии. Реализации можно частично проверить через юнит-тесты и с помощью системы ejudge в соответствующем соревновании.
   
   Внимание. Прохождение всех тестов в соревновании не гарантирует правильность решения.

2. Вывести все необходимые формулы, привести выкладки в отчёте.

3. Провести описанные ниже эксперименты с модельными данными и приложенным датасетом в данном ноутбуке. Подготовить отчёт о проделанной работе. Удалите черновые выводы, оставьте только тот код, который является ответом к пунктам задания. Сохраните ноутбук в форматах .ipynb и .html одновременно.
   
   Замечание. Чтобы экспорировать jupyter notebook в .html нужно выбрать: File -> Download as -> HTML (.html). Для экспорта notebook в .html в Google Colab, воспользуйтесь следующим кодом. Большая просьба: подписывайте свой отчет (в названии файла и внутри ноутбука).

4. В систему проверки необходимо сдать отчёт в обоих форматах и .zip архив с написанными модулями.
   
   Большая просьба: jupyter notebook и html файл не запаковывать в архив, а сдавать отдельно.

Некоторые полезные советы

1. Для того, чтобы не перезагружать jupyter notebook каждый раз после того, как вы внесли изменения в модуль knn, можно добавить ячейку с таким содержимым:

%load_ext autoreload
%autoreload 2

2. Не нужно копировать свой код из модулей в jupyter notebook, пользуйтесь им, как если бы это была библиотека. Для этого поместите директорию modules рядом с notebook-ом. Пример, как может выглядеть содержимое вашей рабочей директории:

tree
    ---modules
    ------__init__.py
    ------linear_model.py
    ------losses.py
    ------utils.py
    ------tests.py
    HW2_*.ipynb

Теоретическая часть (1 балл)

Выведите формулу градиента функции потерь (по параметру $w$) для задачи бинарной логистической регрессии.
Считайте для удобства, что $x[0] = 1$ для любого объекта, то есть $w[0] - \texttt{bias}$.
Так, в выведенном вами градиенте, $\texttt{grad}[1:]$ - градиент по весам, $\texttt{grad}[0]$ - градиент по $\texttt{bias}$.

$$L(a(x), y) = \log(1 + \exp(-y\langle w, x\rangle)), \quad y \in \{-1, 1\}$$

Запишите вывод градиента ниже.

$$\nabla_w L = -yx\frac{\exp(-y\langle w,x \rangle)}{1+\exp(-y\langle w,x \rangle)} = -yx(1-\frac{1}{1+\exp(-y\langle w,x \rangle)})$$

Реализация алгоритмов (9 баллов)

Прототипы функций должны строго соответствовать прототипам, описанным в спецификации и проходить все тесты. Задание, не проходящее все тесты, приравнивается к невыполненному.

При написании необходимо пользоваться стандартными средствами языка Python, библиотеками numpy, scipy и matplotlib. Библиотекой scikit-learn для реализаций пользоваться запрещается, но разрешается использовать её в процессе экспериментов. Все подробности реализации алгоритмов подробно описаны в спецификации к заданию.

Ожидается, что реализациия всех классов и функций будет максимально эффективной. Дополнительно вам предоставлены открытые тесты, которые находятся в модуле modules. Чтобы запустить тесты в консоли требуется выполнить команду:

$ pytest ./modules/tests.py

Разрешается дополнять файл тестами для самопроверки. Доп баллы за написание своих тестов не будет :)

import numpy as np, pandas as pd

%load_ext autoreload
%autoreload 2

# %load_ext - https://ipython.readthedocs.io/en/stable/interactive/magics.html
# %autoreload - https://ipython.org/ipython-doc/3/config/extensions/autoreload.html

data = pd.read_csv('data/application_train.csv')
data.columns = ['_'.join([word.lower() for word in col_name.split(' ') if word != '-']) for col_name in data.columns]

data.target = data.target.map({0: -1, 1: 1})

from IPython.display import display

print('\ntarget value_counts:')
display(data['target'].value_counts(dropna=False))

pd.options.display.max_columns = 100
pd.options.display.max_rows = 150

data.head(3)

target value_counts:

-1    282686
 1     24825
Name: target, dtype: int64

	sk_id_curr	target	name_contract_type	code_gender	flag_own_car	flag_own_realty	cnt_children	amt_income_total	amt_credit	amt_annuity	amt_goods_price	name_type_suite	name_income_type	name_education_type	name_family_status	name_housing_type	region_population_relative	days_birth	days_employed	days_registration	days_id_publish	own_car_age	flag_mobil	flag_emp_phone	flag_work_phone	flag_cont_mobile	flag_phone	flag_email	occupation_type	cnt_fam_members	region_rating_client	region_rating_client_w_city	weekday_appr_process_start	hour_appr_process_start	reg_region_not_live_region	reg_region_not_work_region	live_region_not_work_region	reg_city_not_live_city	reg_city_not_work_city	live_city_not_work_city	organization_type	ext_source_1	ext_source_2	ext_source_3	apartments_avg	basementarea_avg	years_beginexpluatation_avg	years_build_avg	commonarea_avg	elevators_avg	...	apartments_medi	basementarea_medi	years_beginexpluatation_medi	years_build_medi	commonarea_medi	elevators_medi	entrances_medi	floorsmax_medi	floorsmin_medi	landarea_medi	livingapartments_medi	livingarea_medi	nonlivingapartments_medi	nonlivingarea_medi	fondkapremont_mode	housetype_mode	totalarea_mode	wallsmaterial_mode	emergencystate_mode	obs_30_cnt_social_circle	def_30_cnt_social_circle	obs_60_cnt_social_circle	def_60_cnt_social_circle	days_last_phone_change	flag_document_2	flag_document_3	flag_document_4	flag_document_5	flag_document_6	flag_document_7	flag_document_8	flag_document_9	flag_document_10	flag_document_11	flag_document_12	flag_document_13	flag_document_14	flag_document_15	flag_document_16	flag_document_17	flag_document_18	flag_document_19	flag_document_20	flag_document_21	amt_req_credit_bureau_hour	amt_req_credit_bureau_day	amt_req_credit_bureau_week	amt_req_credit_bureau_mon	amt_req_credit_bureau_qrt	amt_req_credit_bureau_year
0	100002	1	Cash loans	M	N	Y	0	202500.0	406597.5	24700.5	351000.0	Unaccompanied	Working	Secondary / secondary special	Single / not married	House / apartment	0.018801	-9461	-637	-3648.0	-2120	NaN	1	1	0	1	1	0	Laborers	1.0	2	2	WEDNESDAY	10	0	0	0	0	0	0	Business Entity Type 3	0.083037	0.262949	0.139376	0.0247	0.0369	0.9722	0.6192	0.0143	0.00	...	0.0250	0.0369	0.9722	0.6243	0.0144	0.00	0.0690	0.0833	0.1250	0.0375	0.0205	0.0193	0.0000	0.00	reg oper account	block of flats	0.0149	Stone, brick	No	2.0	2.0	2.0	2.0	-1134.0	0	1	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0.0	0.0	0.0	0.0	0.0	1.0
1	100003	-1	Cash loans	F	N	N	0	270000.0	1293502.5	35698.5	1129500.0	Family	State servant	Higher education	Married	House / apartment	0.003541	-16765	-1188	-1186.0	-291	NaN	1	1	0	1	1	0	Core staff	2.0	1	1	MONDAY	11	0	0	0	0	0	0	School	0.311267	0.622246	NaN	0.0959	0.0529	0.9851	0.7960	0.0605	0.08	...	0.0968	0.0529	0.9851	0.7987	0.0608	0.08	0.0345	0.2917	0.3333	0.0132	0.0787	0.0558	0.0039	0.01	reg oper account	block of flats	0.0714	Block	No	1.0	0.0	1.0	0.0	-828.0	0	1	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0.0	0.0	0.0	0.0	0.0	0.0
2	100004	-1	Revolving loans	M	Y	Y	0	67500.0	135000.0	6750.0	135000.0	Unaccompanied	Working	Secondary / secondary special	Single / not married	House / apartment	0.010032	-19046	-225	-4260.0	-2531	26.0	1	1	1	1	1	0	Laborers	1.0	2	2	MONDAY	9	0	0	0	0	0	0	Government	NaN	0.555912	0.729567	NaN	NaN	NaN	NaN	NaN	NaN	...	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	NaN	0.0	0.0	0.0	0.0	-815.0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0	0.0	0.0	0.0	0.0	0.0	0.0

3 rows × 122 columns

Неожиданная заметка

С этого момента предлагается некоторым образом отмечать все "неоднозначные" моменты, которые диктует вам домашка. Пример комментирования таких мест в коде - ниже. Если такие места находятся в текстовой ячейке, нужно после нее создать ячейку и прокомментировать желаемые места. Пример:

#*! что такое "неоднозначные" моменты?
#*! "Если такие места находятся в текстовой ячейке..." - не раскрыт случай нахождения таких мест "между строк"

Под "неоднозначными" понимается нечто, что навязывается вам домашкой, но не является по вашему мнению оптимальным / единственно правильным способом сделать / делать то или иное с точки зрения логики.

К таким моментам НЕ относятся, например:
разные способы фиксация сида, способы выбрать рандомные индексы без повторений, в общем все, что "в разных случаях" делает "примерно одно и то же" и работает "примерно одинаково".

Точное количество таких моментов в домашке не определено. Вы сами решаете, что комментировать.

За проявление внимательности можно будет получить бонусные баллы за работу!
За проявление вопиющей невнимательности можно будет потерять баллы за работу!

np.random.seed(911)

test_size = int(0.2 * data.shape[0]) #*! почему 0.2?
val_size = int(0.3 * (data.shape[0] - test_size)) #*! почему 0.3?
test_idx = np.random.choice(data.shape[0], size=test_size, replace=False)

val_idx_candidates = np.setdiff1d(np.arange(data.shape[0]), test_idx)
val_idx = np.random.choice(val_idx_candidates, size=val_size, replace=False)

data_dict = dict()
data_dict['tst'] = data.loc[test_idx].reset_index(drop=True)
data_dict['val'] = data.loc[val_idx].reset_index(drop=True)

not_train_idx = np.union1d(test_idx, val_idx)
data_dict['tr'] = data.drop(index=not_train_idx)
data_dict['tr'].reset_index(drop=True, inplace=True)

for key, df in data_dict.items():
    print(key, 'shape:', df.shape)

tst shape: (61502, 122)
val shape: (73802, 122)
tr shape: (172207, 122)

#Наверху мы разбили данные на трейновую, валидационную и тестовую часть. 
#Можно было случайно перемешать данные, взять первую половину как трейновую, 
#следующие 0.3 от данных валидационную, остальные в тест, используя слайсы.

Часть первая. Погружаемся в "зону адекватности" гиперпараметров (5 баллов)

Будем считать, для начала, что мы провели какую-то предобработку данных, и теперь мы готовы обучать на них нашу модель. Гиперпараметрами, которые хочется подобрать, являются step_alpha, step_beta, batch_size, l2_coef. Будем двигаться к тому, чтобы поизучать, как связаны между собой первые три. Для этого нужно зафиксировать коэффициент l2-регуляризации лосса на каком-нибудь адекватном значении. Будем использовать optuna, чтобы его выяснить (см. соответствующий семинар).

Напишите ниже свою objective_function, которую в дальнейшем будем оптимизировать. Перебираемые гиперпараметры даны выше; подумайте, как лучше задать их распределения. Положите tolerance = 1e-4, max_iter = 30, random_seed = 911.

В качестве меры качества предлагается использовать ваш реализованный BinaryLogisticLoss на валидации без учета слагаемого, отвечающего за регуляризацию.

Совет: не включайте значения batch_size сильно меньше 300, это приведет к долгому времени одной эпохи.

from modules.linear_model import LinearModel
from modules.losses import BinaryLogisticLoss

def objective(trial, X_tr, y_tr, X_val, y_val,**kwargs):
    l2_coef = trial.suggest_float('l2',1e-5, 5, log=True)
    step_alpha = trial.suggest_float('alpha',0.001, 10, log=True)
    step_beta = trial.suggest_float('beta',0.1, 5, log=True)
    batch_size = trial.suggest_int('batch',500, 15000, step=500)
    
    loss_func = BinaryLogisticLoss(l2_coef)
    model = LinearModel(loss_func, batch_size, step_alpha, step_beta, tolerance=1e-4, maxiter=30, random_seed=911, **kwargs)
    model.fit(X_tr, y_tr)

    loss = BinaryLogisticLoss(0).func(X_val, y_val, np.r_[model.get_bias(), model.get_weights()])
    
    return loss

Напишите функцию start_optimization, запускающую сессию оптимизации, используя входные параметры для предобработки данных:

В ней создайте объект сессии оптимизации - study с sampler=sampler. Подготовьте ваш objective_func и данные (в качестве фичей по умолчанию будем использовать все числовые признаки, а обрабатывать данные по умолчанию будем минимальным простым пайплайном, приведенным ниже).

Функция должна возвращать study.

from sklearn.preprocessing import StandardScaler
from sklearn.impute import SimpleImputer
from sklearn.pipeline import make_pipeline
from functools import partial
import optuna
from optuna.visualization import plot_slice

def start_optimization(
    objective_func, # принимает trial, X_tr, y_tr, X_val, y_val, **other_objective_kwargs
    n_trials,
    n_jobs,
    data_dict,
    study_direction=None,
    study_directions=None,
    sampler=None,
    prep=None,
    features=None,
    **other_objective_kwargs
):
    if prep is None:
        prep = make_pipeline(
            StandardScaler(),
            SimpleImputer(strategy='median')
        )
    
    if features is None:
        features = data.select_dtypes(np.number).drop(columns=['target', 'sk_id_curr']).columns

    X_tr, y_tr = prep.fit_transform(data_dict['tr'][features]), data_dict['tr'].target
    X_val, y_val = prep.transform(data_dict['val'][features]), data_dict['val'].target
    
    study = optuna.create_study(direction=study_direction, sampler=sampler, directions=study_directions)
    
    objective_args = partial(objective_func, X_tr=X_tr, y_tr=y_tr, X_val=X_val, y_val=y_val, **other_objective_kwargs)
    study.optimize(func=objective_args, n_trials=n_trials, timeout=None, n_jobs=n_jobs)

    return study

Запустите процесс оптимизации с TPESampler, предварительно настроив, как минимум, n_startup_trials; подумайте, какое n_trials выбрать.

tpe_sampler = optuna.samplers.TPESampler(n_startup_trials=20)
res = start_optimization(objective_func=objective, n_trials=100, n_jobs=-1, 
                         data_dict=data_dict, study_direction='minimize', sampler=tpe_sampler)

[I 2022-11-24 14:41:59,400] A new study created in memory with name: no-name-042388b6-b558-4a19-b7b7-88fa31c3cee9
[I 2022-11-24 14:43:01,337] Trial 0 finished with value: 0.31580807748820017 and parameters: {'l2': 0.20234971104154767, 'alpha': 0.062296786479906475, 'beta': 1.3089040338496618, 'batch': 4500}. Best is trial 0 with value: 0.31580807748820017.
[I 2022-11-24 14:43:16,187] Trial 1 finished with value: 0.2539500078202875 and parameters: {'l2': 8.64192855746519e-05, 'alpha': 0.1604484882455346, 'beta': 0.23980715655513263, 'batch': 4000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:43:21,662] Trial 2 finished with value: 0.25657435816299956 and parameters: {'l2': 0.021435617538599662, 'alpha': 0.9521947257289788, 'beta': 1.776136518625077, 'batch': 1000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:44:00,341] Trial 3 finished with value: 0.2695642791666174 and parameters: {'l2': 3.510184215791309e-05, 'alpha': 0.008729845045817702, 'beta': 0.1018173181437677, 'batch': 14500}. Best is trial 1 with value: 0.25509658834527277.
[I 2022-11-24 14:45:22,064] Trial 3 finished with value: 0.27706004580233656 and parameters: {'l2': 0.6049794391264904, 'alpha': 2.361845621638213, 'beta': 0.13943403421522577, 'batch': 10000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:45:34,696] Trial 4 finished with value: 0.2545955054725704 and parameters: {'l2': 6.734920363082613e-05, 'alpha': 0.16822094665821538, 'beta': 0.11271698154559386, 'batch': 12500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:45:41,892] Trial 5 finished with value: 0.26929111977569264 and parameters: {'l2': 0.009613580640933794, 'alpha': 0.626617453817703, 'beta': 1.7941260641077967, 'batch': 12000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:45:49,880] Trial 6 finished with value: 0.2702649659364741 and parameters: {'l2': 0.1760174452642354, 'alpha': 0.45197049401280787, 'beta': 0.7729013552976576, 'batch': 12000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:47:04,766] Trial 7 finished with value: 0.30210836952447184 and parameters: {'l2': 0.06260350719549021, 'alpha': 0.034096570820227934, 'beta': 0.8231679449565409, 'batch': 6500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:47:06,168] Trial 8 finished with value: 0.26997193962758803 and parameters: {'l2': 0.19018617609783353, 'alpha': 0.5056790414143191, 'beta': 0.1231018496286056, 'batch': 2500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:47:10,923] Trial 9 finished with value: 0.28001918548433424 and parameters: {'l2': 1.0167175195052185, 'alpha': 0.439286419076288, 'beta': 1.619956582187333, 'batch': 6500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:54:17,065] Trial 10 finished with value: 3.2094914825472984 and parameters: {'l2': 0.9233621178267937, 'alpha': 2.261656095095925, 'beta': 1.1465828377727052, 'batch': 4000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:54:19,200] Trial 11 finished with value: 0.3417942252531113 and parameters: {'l2': 0.00904898447171454, 'alpha': 0.34403384932956044, 'beta': 4.756446395153002, 'batch': 13500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:54:25,527] Trial 12 finished with value: 0.26776075483205736 and parameters: {'l2': 0.13296129169688653, 'alpha': 0.028835494684035123, 'beta': 0.7248109435210757, 'batch': 500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:54:34,042] Trial 13 finished with value: 0.2546035094647365 and parameters: {'l2': 0.00012333618937488617, 'alpha': 0.1366670779383527, 'beta': 0.5498300309029311, 'batch': 3000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:54:38,088] Trial 14 finished with value: 0.2699284422849316 and parameters: {'l2': 0.14775454798445403, 'alpha': 2.1881679476117397, 'beta': 2.1280997289241905, 'batch': 11500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:55:27,702] Trial 15 finished with value: 0.25837535771038805 and parameters: {'l2': 0.004332106621536682, 'alpha': 0.0015132889478645026, 'beta': 0.10487210431001717, 'batch': 500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 14:55:52,187] Trial 16 finished with value: 0.2585866536010166 and parameters: {'l2': 0.00016339764977480224, 'alpha': 8.251684367243687, 'beta': 0.21261610803392086, 'batch': 8000}. Best is trial 1 with value: 0.2539500078202875.
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:84: RuntimeWarning: overflow encountered in multiply
  self.w -= step * grad
/home/bogdan/masters/ml1/hw4/modules/losses.py:73: RuntimeWarning: overflow encountered in multiply
  grad_w = 2*self.l2_coef*weights + np.mean(X*multiplier.reshape(-1,1), axis=0)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
/home/bogdan/.local/lib/python3.10/site-packages/pandas/core/arraylike.py:397: RuntimeWarning: invalid value encountered in logaddexp
  result = getattr(ufunc, method)(*inputs, **kwargs)
[W 2022-11-24 15:03:52,005] Trial 17 failed because of the following error: The value nan is not acceptable.
[I 2022-11-24 15:03:55,835] Trial 18 finished with value: 0.26677902713817125 and parameters: {'l2': 0.09928365894603719, 'alpha': 0.6158550546073224, 'beta': 0.3076019669615014, 'batch': 500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 15:04:02,097] Trial 19 finished with value: 0.5896222026683126 and parameters: {'l2': 0.2728782148381697, 'alpha': 0.0055094046323948724, 'beta': 2.3594899472535067, 'batch': 3000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 15:04:57,347] Trial 20 finished with value: 0.2834419338181586 and parameters: {'l2': 1.6045753745817752, 'alpha': 0.010830855280531458, 'beta': 0.14235453741772963, 'batch': 8000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 15:05:19,787] Trial 21 finished with value: 0.2563801356565736 and parameters: {'l2': 1.0043869116672228e-05, 'alpha': 0.1098835950547215, 'beta': 0.23482705327760406, 'batch': 14000}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 15:05:35,187] Trial 22 finished with value: 0.2556511085548696 and parameters: {'l2': 0.00013968710344929583, 'alpha': 0.15188192191854757, 'beta': 0.3484083357308441, 'batch': 9500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 15:05:52,704] Trial 23 finished with value: 0.2560552169405918 and parameters: {'l2': 0.00016730546884202466, 'alpha': 0.10262866510213586, 'beta': 0.45108736306977454, 'batch': 5500}. Best is trial 1 with value: 0.2539500078202875.
[I 2022-11-24 15:05:58,048] Trial 24 finished with value: 0.2537391535847537 and parameters: {'l2': 1.7393252110071413e-05, 'alpha': 0.20147150952163073, 'beta': 0.49846569844894206, 'batch': 2500}. Best is trial 24 with value: 0.2537391535847537.
[I 2022-11-24 15:06:02,368] Trial 25 finished with value: 0.2533835309141942 and parameters: {'l2': 3.0350970382223735e-05, 'alpha': 0.2142712979953057, 'beta': 0.18947597183928072, 'batch': 2000}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:06:13,880] Trial 26 finished with value: 0.25439967023366844 and parameters: {'l2': 1.0368344000063465e-05, 'alpha': 0.041328293975153835, 'beta': 0.1965940270239723, 'batch': 2000}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:07:08,435] Trial 27 finished with value: 0.26321526432348763 and parameters: {'l2': 0.0008165766457805802, 'alpha': 0.01538790211152826, 'beta': 0.3329656140809654, 'batch': 4500}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:07:12,355] Trial 28 finished with value: 0.2534293498424837 and parameters: {'l2': 3.654196406348322e-05, 'alpha': 0.22802171605902574, 'beta': 0.17804888788696846, 'batch': 2000}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:07:16,679] Trial 29 finished with value: 0.2538011756707916 and parameters: {'l2': 2.7415283846438098e-05, 'alpha': 1.3761405745662059, 'beta': 0.48136698525435984, 'batch': 2000}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:07:32,399] Trial 30 finished with value: 0.25510167853692856 and parameters: {'l2': 0.000586926490960841, 'alpha': 0.06552321245236539, 'beta': 0.17528119744181186, 'batch': 5500}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:07:45,627] Trial 31 finished with value: 0.25859345038392473 and parameters: {'l2': 2.7776291155637445e-05, 'alpha': 7.5077309113568065, 'beta': 0.2926025836723085, 'batch': 1500}. Best is trial 25 with value: 0.2533835309141942.
[I 2022-11-24 15:07:48,539] Trial 32 finished with value: 0.25329394723432685 and parameters: {'l2': 4.749816545398213e-05, 'alpha': 1.2060753095315075, 'beta': 0.4906770928679839, 'batch': 3000}. Best is trial 32 with value: 0.25329394723432685.
[I 2022-11-24 15:07:54,548] Trial 33 finished with value: 0.2538223847214902 and parameters: {'l2': 0.0004813329405751745, 'alpha': 0.2438164255892326, 'beta': 0.4136511499421965, 'batch': 3500}. Best is trial 32 with value: 0.25329394723432685.
[I 2022-11-24 15:07:57,674] Trial 34 finished with value: 0.25340479900794205 and parameters: {'l2': 3.2775368991213856e-05, 'alpha': 1.2021457722640103, 'beta': 1.0133287887893945, 'batch': 5000}. Best is trial 32 with value: 0.25329394723432685.
[I 2022-11-24 15:08:01,337] Trial 35 finished with value: 0.25300738978891074 and parameters: {'l2': 5.728104324497741e-05, 'alpha': 4.677022227432745, 'beta': 1.2133467545928827, 'batch': 5500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 15:08:05,856] Trial 36 finished with value: 0.2532395208598405 and parameters: {'l2': 0.0017712222714511144, 'alpha': 5.842094057021943, 'beta': 1.0942672368196789, 'batch': 5000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 15:08:10,149] Trial 37 finished with value: 0.2780096022645459 and parameters: {'l2': 0.002059027898376858, 'alpha': 4.713640512878391, 'beta': 3.0182035217430316, 'batch': 6500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 15:08:13,937] Trial 38 finished with value: 0.25308696698623245 and parameters: {'l2': 0.00033281016940899715, 'alpha': 4.588307038830948, 'beta': 1.4108150651474538, 'batch': 4000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 15:08:16,602] Trial 39 finished with value: 0.2531151490987969 and parameters: {'l2': 0.00029597799500553977, 'alpha': 4.63916053653929, 'beta': 1.364001589034244, 'batch': 4000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:32:35,711] Trial 40 finished with value: 0.25308656923990863 and parameters: {'l2': 0.0016026739911700822, 'alpha': 4.5457534476010455, 'beta': 1.2673384126801843, 'batch': 6000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:32:37,189] Trial 41 finished with value: 0.2530452590683108 and parameters: {'l2': 0.00035059884541866534, 'alpha': 4.1384538545803204, 'beta': 1.4017906731499141, 'batch': 7500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:32:38,641] Trial 42 finished with value: 0.2533937827921811 and parameters: {'l2': 0.0003543073820752319, 'alpha': 3.6701237485422578, 'beta': 1.4172182140979817, 'batch': 9000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:32:39,857] Trial 43 finished with value: 0.2531811214015501 and parameters: {'l2': 0.0012778202009954872, 'alpha': 3.370092933507485, 'beta': 1.3690166897485274, 'batch': 7000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:32:41,336] Trial 44 finished with value: 0.253347874360268 and parameters: {'l2': 0.0003171209952023956, 'alpha': 1.9516949621768342, 'beta': 0.9118210110966999, 'batch': 7500}. Best is trial 35 with value: 0.25300738978891074.
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
/home/bogdan/masters/ml1/hw4/modules/losses.py:54: RuntimeWarning: overflow encountered in matmul
  return np.mean(np.logaddexp(0, -(X.dot(weights)+w[0])*y)) + self.l2_coef * weights @ weights
/home/bogdan/masters/ml1/hw4/modules/linear_model.py:95: RuntimeWarning: invalid value encountered in double_scalars
  if abs(curr_func - prev_func) < self.tolerance:
[I 2022-11-24 17:35:19,512] Trial 45 finished with value: 15.380918787804449 and parameters: {'l2': 4.573297977965694, 'alpha': 8.756251381196504, 'beta': 1.702460471146489, 'batch': 6000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:22,428] Trial 46 finished with value: 0.2538417042016172 and parameters: {'l2': 0.004583613125968777, 'alpha': 3.227449230716368, 'beta': 2.7556863678387624, 'batch': 4000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:26,590] Trial 47 finished with value: 0.2532346899388321 and parameters: {'l2': 8.690810608839928e-05, 'alpha': 4.850050302753765, 'beta': 0.6323093679657004, 'batch': 8500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:32,876] Trial 48 finished with value: 0.2559800798451148 and parameters: {'l2': 0.0002635703206420856, 'alpha': 0.9649703469445764, 'beta': 1.272064083280453, 'batch': 10500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:35,100] Trial 49 finished with value: 0.2539074799497873 and parameters: {'l2': 7.367568309540017e-05, 'alpha': 1.8768487486869496, 'beta': 1.9885017307790354, 'batch': 7000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:39,284] Trial 50 finished with value: 0.2594209149081092 and parameters: {'l2': 0.037658241203528994, 'alpha': 2.7877668496333654, 'beta': 0.8902773338595338, 'batch': 4500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:51,140] Trial 51 finished with value: 0.25321581213345573 and parameters: {'l2': 0.0008354177616412151, 'alpha': 5.713213983798578, 'beta': 1.4439918960441833, 'batch': 6000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:35:57,757] Trial 52 finished with value: 0.25301847075677314 and parameters: {'l2': 0.0016273306483899142, 'alpha': 9.6001934397049, 'beta': 1.2457651418951772, 'batch': 7500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:36:02,817] Trial 53 finished with value: 0.2536330289160601 and parameters: {'l2': 0.0054441234985693485, 'alpha': 6.730711301647731, 'beta': 1.1188012455191483, 'batch': 7500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:36:05,291] Trial 54 finished with value: 0.2536077677249425 and parameters: {'l2': 0.002137323781086526, 'alpha': 3.8612740182032446, 'beta': 0.6665379078338554, 'batch': 6000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:36:07,968] Trial 55 finished with value: 0.25676972644106544 and parameters: {'l2': 0.022164673293034967, 'alpha': 1.64022315017734, 'beta': 1.5899736484665763, 'batch': 5000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:36:33,388] Trial 56 finished with value: 0.29904082829153283 and parameters: {'l2': 0.0002130703790464999, 'alpha': 9.074142524086723, 'beta': 2.0659784657696894, 'batch': 8500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:36:41,089] Trial 57 finished with value: 0.2535116989177604 and parameters: {'l2': 0.0012446527128594604, 'alpha': 2.470140668013299, 'beta': 3.4778782083357043, 'batch': 3500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:36:55,580] Trial 58 finished with value: 0.2552153387881018 and parameters: {'l2': 0.003500422484322285, 'alpha': 0.7932390098213059, 'beta': 1.2099749179560537, 'batch': 7000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:08,931] Trial 59 finished with value: 0.253811775091654 and parameters: {'l2': 0.0008279351655936066, 'alpha': 9.035167080125456, 'beta': 0.9867174723552627, 'batch': 4000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:11,845] Trial 60 finished with value: 0.25445428515165613 and parameters: {'l2': 0.009050786430118661, 'alpha': 5.193402792506326, 'beta': 2.457007415370024, 'batch': 10000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:14,376] Trial 61 finished with value: 0.25317979015653547 and parameters: {'l2': 0.00011085659315522075, 'alpha': 2.6686307560251326, 'beta': 0.8312386825712251, 'batch': 5500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:16,989] Trial 62 finished with value: 0.25334609930858876 and parameters: {'l2': 9.012297784995238e-05, 'alpha': 4.039415885448158, 'beta': 0.7905494950312658, 'batch': 5500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:18,662] Trial 63 finished with value: 0.25320423036746487 and parameters: {'l2': 0.0001326907275694405, 'alpha': 2.714421540543395, 'beta': 1.5559715652185002, 'batch': 6000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:22,888] Trial 64 finished with value: 0.25326479572721855 and parameters: {'l2': 0.00047163362749580364, 'alpha': 6.417882534090473, 'beta': 1.767236260070819, 'batch': 5000}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:25,047] Trial 65 finished with value: 0.2530260090473608 and parameters: {'l2': 5.682696624428037e-05, 'alpha': 4.230161437862459, 'beta': 1.2568758903597252, 'batch': 6500}. Best is trial 35 with value: 0.25300738978891074.
[I 2022-11-24 17:37:32,451] Trial 66 finished with value: 0.25275899176239414 and parameters: {'l2': 5.8599204967086434e-05, 'alpha': 9.910225936952216, 'beta': 1.252095816005187, 'batch': 6500}. Best is trial 66 with value: 0.25275899176239414.
[I 2022-11-24 17:37:37,299] Trial 67 finished with value: 0.2527530084230728 and parameters: {'l2': 1.6947453259164358e-05, 'alpha': 9.896622251994028, 'beta': 1.2256893486638332, 'batch': 6500}. Best is trial 67 with value: 0.2527530084230728.
[I 2022-11-24 17:37:55,626] Trial 68 finished with value: 0.2893814519620201 and parameters: {'l2': 6.091580889400563e-05, 'alpha': 6.776388609275792, 'beta': 1.9226700973927424, 'batch': 8000}. Best is trial 67 with value: 0.2527530084230728.
[I 2022-11-24 17:38:02,443] Trial 69 finished with value: 0.2527482008623747 and parameters: {'l2': 1.8804454258147846e-05, 'alpha': 9.78380235393329, 'beta': 1.1838898293961089, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:07,828] Trial 70 finished with value: 0.2528350311538286 and parameters: {'l2': 1.6644611572282025e-05, 'alpha': 9.018678745089751, 'beta': 1.0412999178780284, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:11,128] Trial 71 finished with value: 0.2528156938076159 and parameters: {'l2': 1.752054037981778e-05, 'alpha': 9.492225414999707, 'beta': 0.9634093173962984, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:15,393] Trial 72 finished with value: 0.25286474352988064 and parameters: {'l2': 1.4981288838405024e-05, 'alpha': 9.878127819808173, 'beta': 1.0205217393367148, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:20,983] Trial 73 finished with value: 0.25285177387685936 and parameters: {'l2': 1.494729894937295e-05, 'alpha': 9.741569992085287, 'beta': 1.0389941089081287, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:29,980] Trial 74 finished with value: 0.25274857904498566 and parameters: {'l2': 1.7070643310765607e-05, 'alpha': 7.443180617400214, 'beta': 1.034092287913626, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:33,913] Trial 75 finished with value: 0.25334854077477836 and parameters: {'l2': 1.6000297193241306e-05, 'alpha': 9.66080938392764, 'beta': 0.5838046882930691, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:41,148] Trial 76 finished with value: 0.2530346090147277 and parameters: {'l2': 1.67341703647225e-05, 'alpha': 7.215257479387104, 'beta': 0.7405077273169824, 'batch': 8500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:47,922] Trial 77 finished with value: 0.2528676876532031 and parameters: {'l2': 2.127397863239106e-05, 'alpha': 9.984866312358195, 'beta': 1.0261455845934286, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:38:54,784] Trial 78 finished with value: 0.2527811220426616 and parameters: {'l2': 1.0193115937770611e-05, 'alpha': 7.257924679468019, 'beta': 0.927934220691123, 'batch': 8000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:39:50,166] Trial 79 finished with value: 0.6454316424131105 and parameters: {'l2': 1.0601074198132085e-05, 'alpha': 0.0010347467692545197, 'beta': 0.875126959722595, 'batch': 8000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:39:55,715] Trial 80 finished with value: 0.25282972183707425 and parameters: {'l2': 3.86473096540095e-05, 'alpha': 7.221104159441642, 'beta': 1.1252304760382945, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:01,073] Trial 81 finished with value: 0.2532289137223704 and parameters: {'l2': 4.3072783849814053e-05, 'alpha': 6.84916504003442, 'beta': 0.9294656345635949, 'batch': 9000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:06,622] Trial 82 finished with value: 0.252856549923796 and parameters: {'l2': 2.2252511041777638e-05, 'alpha': 5.988898076765007, 'beta': 1.1063720328697213, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:10,791] Trial 83 finished with value: 0.25300407762790245 and parameters: {'l2': 1.2196882809870687e-05, 'alpha': 7.624572582111748, 'beta': 0.7250067286513677, 'batch': 7500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:15,048] Trial 84 finished with value: 0.25297336971872675 and parameters: {'l2': 2.4974030619386833e-05, 'alpha': 5.807172190026826, 'beta': 0.818717414739195, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:20,643] Trial 85 finished with value: 0.2528739622655065 and parameters: {'l2': 3.631138106684623e-05, 'alpha': 7.669725824757875, 'beta': 1.1300449252407105, 'batch': 8000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:22,769] Trial 86 finished with value: 0.25307596933989823 and parameters: {'l2': 1.3660478112267003e-05, 'alpha': 3.137064423639966, 'beta': 0.9641167060928457, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:35,495] Trial 87 finished with value: 0.2581083093919996 and parameters: {'l2': 1.8780607611514637e-05, 'alpha': 7.761140179126408, 'beta': 1.5292599273518122, 'batch': 9000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:40:38,500] Trial 88 finished with value: 0.25330271837193596 and parameters: {'l2': 4.147206957125844e-05, 'alpha': 5.546086996383257, 'beta': 0.6454513474696352, 'batch': 6000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:41:32,393] Trial 89 finished with value: 0.5803128555578423 and parameters: {'l2': 1.0110241140240496e-05, 'alpha': 0.003871621597516912, 'beta': 1.042207482523432, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:41:34,983] Trial 90 finished with value: 0.2532441415970669 and parameters: {'l2': 3.06595283154907e-05, 'alpha': 3.454978904721685, 'beta': 0.5545363832664355, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:41:46,467] Trial 91 finished with value: 0.25653948074225563 and parameters: {'l2': 2.3203714268487538e-05, 'alpha': 0.32714946339785395, 'beta': 0.7735642293586799, 'batch': 8500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:41:52,460] Trial 92 finished with value: 0.2529665529951806 and parameters: {'l2': 2.191132036439304e-05, 'alpha': 5.834616039306369, 'beta': 1.1340881138759984, 'batch': 7500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:41:56,339] Trial 93 finished with value: 0.25284648899953444 and parameters: {'l2': 4.963212455675263e-05, 'alpha': 7.643539317265659, 'beta': 0.9033539503009491, 'batch': 7000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:42:01,142] Trial 94 finished with value: 0.25292285017199817 and parameters: {'l2': 4.910242805652951e-05, 'alpha': 8.245336871895896, 'beta': 0.9180605850307847, 'batch': 6500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:42:04,978] Trial 95 finished with value: 0.25284422161085046 and parameters: {'l2': 1.3922497437904366e-05, 'alpha': 7.625631777841099, 'beta': 0.8620995083696177, 'batch': 8000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:42:08,267] Trial 96 finished with value: 0.25289714470960684 and parameters: {'l2': 3.032642318485182e-05, 'alpha': 5.268748250580895, 'beta': 0.8848673126213142, 'batch': 8000}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:42:12,028] Trial 97 finished with value: 0.25303873438882485 and parameters: {'l2': 6.581467347519051e-05, 'alpha': 7.629927163932877, 'beta': 0.706236676378739, 'batch': 7500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:42:41,008] Trial 98 finished with value: 0.31155739376439484 and parameters: {'l2': 3.656844881072592e-05, 'alpha': 0.07253813173243644, 'beta': 1.298508942449074, 'batch': 5500}. Best is trial 69 with value: 0.2527482008623747.
[I 2022-11-24 17:42:44,059] Trial 99 finished with value: 0.2533618165230278 and parameters: {'l2': 1.2988274744512268e-05, 'alpha': 3.7170425298972987, 'beta': 0.8375767901030136, 'batch': 9000}. Best is trial 69 with value: 0.2527482008623747.

Визуализируйте результаты оптимизации с помощью optuna.visualization.plot_slice.

plot_slice(res)

Опишите свои наблюдения. Если наблюдать вам мешает кривой масштаб графиков из-за слишком высоких значений лосса для некоторых trials, можно "зазумиться" в нужный интервал, выделяя на графике нужное подмножество точек или использовать аргумент target.

Как видно из графика, alpha и beta сошлись к окрестностям 10 и 1 соответственно. Batch начал группироваться около 7000.

Что касается коэффициента регурялизации, то его значения сгруппировались около 18 * 10^-5

Ответьте на вопросы:

1. Почему не нужно включать слагаемое, отвечающее за регуляризацию, в подсчет лосса для подбора гиперпараметров?

Потому что мы хотим оценить, насколько верно/неверно наша модель предсказывает метки классов. Модель выдает значение sign($\langle x, w\rangle$). В эту формулу не входит значение w^Tw. Такое слагаемое нужно лишь для регуляризации весов, чтобы не было переобучения. Если посмотреть на функцию лосса $log(1+\exp(\langle w,x\rangle))$, то минимизируя лосс, мы максимизируем MML оценку для объектов. И квадрат нормы весов не входит в формулу подсчета веростности $p(y+1|x)$, поэтому надо его откинуть, иначе он будет вносить шум в оценку корректности работы модели.

Также если бы мы включили в подсчет лосса коэффициент регуляризации, оптуна бы просто его обнулила, так как независимо от весов, обнуление коэфа l2 дает понижение лосса. Естественно мы этого не хотим, так как исчезнет регуляризация.

2. Почему, если нашей целью является подбор адекватного коэффициента l2-регуляризации, мы включали в перебор остальные гиперпараметры?

Мы хотим немного приблизить оценку параметров, которые будем изучать дальше. Плюс при разных гиперпараметрах alpha, beta и batch могут быть разные оптимальные l_2, поэтому хочется увидеть поведение лосса и коэффициента регуляризации при разных гиперпараметрах и выбрать их оптимальный набор.

Давайте теперь посмотрим на то, что у нас получилось. Предлагается не сразу брать лучший по скору оптимизации trial, а сделать вывод, используя дополнительные данные.

Используя график plot_slice выше и study.trials, выберите 3 лучших на ваш взгляд trial-кандидата для дальнейшего изучения.
Объясните ваш выбор. Если нужно, визуализируйте адекватным и наглядным образом вашу логику, чтобы проверяющий мог без труда в ней убедиться.

Возмьем trial с самым лучшим скором, и еще два из последних trials, которые имеют наименьший скор. Логика такая, что в процессе перебора гиперпараметры скорее всего сошлись к оптимальным.

look_study = optuna.create_study()
for t in res.trials[-20:]:
    look_study.add_trial(t)
plot_slice(look_study)

[I 2022-11-24 18:04:13,528] A new study created in memory with name: no-name-3e7c3bcc-a1cd-478d-a4d0-781dbf247763

trial1 = res.best_trial

trial2 = res.trials[-1]
trial3 = res.trials[-2]
top_trials = [trial1, trial2, trial3]

Мы выбрали три лучших trials с довольно разнообразными параметрами.

Обучите по модели на каждый trial, собирая историю на обучении и валидации. Положите обученные модели и полученные истории в словари по ключу trial.number.

history_top3 = {}
models_top3 = {}

for t in top_trials:
    loss_func = BinaryLogisticLoss(t.params['l2'])
    model = LinearModel(loss_func, t.params['batch'], t.params['alpha'], t.params['beta'], 1e-4, 30, 911)
    features = data.select_dtypes(np.number).drop(columns=['target', 'sk_id_curr']).columns
    prep = make_pipeline(
            StandardScaler(),
            SimpleImputer(strategy='median')
        )
    
    X_tr, y_tr = prep.fit_transform(data_dict['tr'][features]), data_dict['tr'].target
    X_val, y_val = prep.transform(data_dict['val'][features]), data_dict['val'].target
    h = model.fit(X_tr, y_tr, w_0 = None, trace=True, X_val=X_val, y_val=y_val)
    history_top3[t.number] = h
    models_top3[t.number] = model

Напишите функцию plot_trial_info, которая выводит "информацию" о поданном trial. В эту "информацию" обязательно должно входить:

• График feature - weight, показывающий top_k признаков по модулю веса и их значения весов. Признаки должны идти по убыванию модуля веса.
  Используйте ax.barh.
  Используйте ax.bar_label, чтобы подписать веса к барам.
  Используйте ax.set_title(f'l2_coef: {l2_coef:.2e}', fontsize=15) для этого графика.

• График "время обучения - лосс" - на обучении и валидации. Укажите "количество эпох | batch_size" в качестве title к этому графику.
  Используйте ax.plot.

• Что угодно еще, что поможет вам принять решение о том, почему вы выберете один trial из этих трех.

Настройте размер графиков, шрифт, легенду. Убедитесь, что в вашей "информации" присутствует trial.number, batch_size.
Визуализируйте выбранные вами trials. Убедитесь в адекватности графиков.

import matplotlib.pyplot as plt

def plot_trial_info(trial, models, history, top_k, *your_args, **your_kwargs):
    model = models[trial.number]
    history = history[trial.number]
    weights = model.get_weights()
    
    ind = np.argpartition(abs(weights), -top_k)[-top_k:]
    ind_ = np.argsort(abs(weights[ind]))
    ind = ind[ind_]
    
    weights = np.round(weights[ind], 4)
    features = data.select_dtypes(np.number).drop(columns=['target', 'sk_id_curr']).columns[ind] 
    
    hbars = axes[0].barh(np.arange(len(weights)), weights, align='center')
    axes[0].set_yticks(np.arange(len(weights)))
    axes[0].set_yticklabels(features)
    axes[0].bar_label(hbars)
    axes[0].set_title(f'l2_coef: {trial.params["l2"]:.3e}', fontsize=15)
    axes[0].set_xlabel('weights')
    axes[0].margins(x=0.2)
    
    time = np.cumsum(history['time'])
    axes[1].plot(time, history['func'], label="train")
    axes[1].plot(time, history['func_val'], label="val")
    axes[1].set_title(f'total epochs:{len(history["func"])}|batch_size:{trial.params["batch"]}', fontsize=15)
    axes[1].set_ylabel('loss')
    axes[1].set_xlabel('time')

top_k = 8

for trial in top_trials:
    fig, axes = plt.subplots(1,2, tight_layout=True, figsize=(11,6))
    plot_trial_info(trial, models_top3, history_top3, top_k, axes)
    axes[1].legend(loc='upper right',prop={'size': 10})
    plt.show()

Опишите свои наблюдения. Если нужно, подключите визуализацию.

Все лучшие trials имеют одинаковые топ 8 фичей по весу, а также почти одинаковый скор как на трейне, так и на тесте.

Какой в итоге коэффициент l2-регуляризации будем фиксировать для дальнейших экспериментов?
Ответ объясните :)

Будем в качестве коэффициента регуляризации использовать значение 0.01, так как на нем модели давали лучшее решение, плюс время обучения на нем гораздо меньше.

best_l2 = 1.3*1e-5

Часть вторая. Research (6 баллов)

Давайте зафиксируем выбранный коэффициент регуляризации и проведем несколько экспериментов с step_alpha, step_beta, batch_size. Но для начала посмотрим - возможно, нам удастся уменьшить размер признакового пространства без сильной потери качества, чтобы ускорить наши эксперименты.

Достаньте из словаря модель, соответствующую выбранному вами лучшему trial, и нарисуйте график отсортированных модулей ее весов.

best_model = models_top3[trial2.number]

plt.plot(sorted(abs(best_model.get_weights())))
plt.show()

Подумайте, можно ли убрать какую-то долю признаков? Если да, то какие признаки вы уберете для дальнейших экспериментов?
Ответ объясните. Могут ли возникнуть какие-то проблемы в дальнейшем?

Можно убрать долю весов, которые слишком малы, например по трешхолду или перцентиль. Раз у них малые веса, то модель сочла их неважными, то есть они нескоррелированы с признаками(не влияют на таргет), поэтому можно их отбросить. График растет гиперболически, значит очень много ненужных весов.

Проблема данного подхода, что модель могла выучить нелогичную связь, например зависимость продаж конфет от погоды или температуры. Поэтому мы можем отсечь часть признаков, которые вообще говоря полезны при предсказании.

Уберем половину признаков, которые соответсвуют топ 60 самым малым весам.

ind_leave = np.argsort(abs(best_model.get_weights()))
best_features = data.select_dtypes(np.number).drop(columns=['target', 'sk_id_curr']).columns[ind_leave[60:]]

Напишите новую функцию research_objective для перебора step_alpha, step_beta при фиксированных l2_coef, batch_size. Остальные гиперпараметры оставьте без изменений с прошлого раза. Для перебора step_alpha используйте log-шкалу от 1e-3 до 20, для перебора step_beta - log-шкалу от 0.1 до 5.

Для batch_size = 300, 1000, 10000, None запустите по сессии оптимизации на выбранном вами (под)множестве признаков, собирая каждый study в словарик по ключу batch_size. Используйте n_trials = 200, TPESampler с параметром n_startup_trials = 100.

def research_objective(trial, X_tr, y_tr, X_val, y_val,**kwargs):
    step_alpha = trial.suggest_float('alpha',1e-3, 20, log=True)
    step_beta = trial.suggest_float('beta',0.1, 5, log=True)
    
    loss_func = BinaryLogisticLoss(best_l2)
    model = LinearModel(loss_function=loss_func, batch_size=batch_size, 
                        step_alpha=step_alpha, step_beta=step_beta, tolerance=1e-4, max_iter=30, random_seed=911)
    model.fit(X_tr, y_tr)
    
    loss = BinaryLogisticLoss(0).func(X_val, y_val, np.r_[model.get_bias(), model.get_weights()])
    
    return loss

tpe_sampler = optuna.samplers.TPESampler(n_startup_trials=100)
research_studies = {}
for batch_size in [300, 1000, 10000, None]:
    res1 = start_optimization(objective_func=research_objective, n_trials=200, 
                             n_jobs=-1, data_dict=data_dict, study_direction='minimize', 
                             study_directions=None, sampler=tpe_sampler, batch_size=batch_size, 
                              features=best_features)
    research_studies[batch_size] = res1

[I 2022-11-24 18:16:48,549] A new study created in memory with name: no-name-01a25b84-9205-4a67-a8f1-dbfee26b5cd6
[I 2022-11-24 18:16:55,475] Trial 0 finished with value: 0.2527242007191018 and parameters: {'alpha': 4.668589642230611, 'beta': 2.313833095693773}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:17:09,675] Trial 1 finished with value: 0.2543529119276804 and parameters: {'alpha': 0.00950263399774877, 'beta': 0.40965464359118753}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:17:14,046] Trial 2 finished with value: 0.39445856146265357 and parameters: {'alpha': 0.005132819256100053, 'beta': 4.536409561476916}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:17:35,201] Trial 3 finished with value: 1.6627864232350131 and parameters: {'alpha': 12.390127020912288, 'beta': 0.2819480512764626}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:17:38,542] Trial 4 finished with value: 0.25316596567769595 and parameters: {'alpha': 0.3303266355941749, 'beta': 0.9166536275324605}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:18:03,786] Trial 5 finished with value: 0.2714716391028031 and parameters: {'alpha': 2.7084597912674107, 'beta': 0.4604635516256166}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:18:07,714] Trial 6 finished with value: 0.25307017297776413 and parameters: {'alpha': 0.4547150525797008, 'beta': 1.1584721528828978}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:18:11,639] Trial 7 finished with value: 0.25439088990532327 and parameters: {'alpha': 0.08235297033229229, 'beta': 3.3563249874717496}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:18:18,633] Trial 8 finished with value: 0.25331428788219335 and parameters: {'alpha': 0.5980603162549213, 'beta': 0.7820491338738728}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:18:22,459] Trial 9 finished with value: 0.2530681219835898 and parameters: {'alpha': 0.5144207741576745, 'beta': 1.0693010376108234}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:18:42,380] Trial 10 finished with value: 0.4794893369143407 and parameters: {'alpha': 0.0011198980641968378, 'beta': 1.3932655080285188}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:19:01,499] Trial 11 finished with value: 0.25519902526499944 and parameters: {'alpha': 0.00510225857304174, 'beta': 0.32799568546993363}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:19:07,867] Trial 12 finished with value: 0.25355162719795227 and parameters: {'alpha': 0.3063320528885231, 'beta': 0.504148850138666}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:19:17,377] Trial 13 finished with value: 0.25662196978201557 and parameters: {'alpha': 0.44231034753264115, 'beta': 0.21323375572445727}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:19:19,428] Trial 14 finished with value: 0.2538297108450468 and parameters: {'alpha': 0.6423514562225574, 'beta': 4.039201557810061}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:19:27,142] Trial 15 finished with value: 0.391053892211789 and parameters: {'alpha': 0.004253633682108431, 'beta': 2.5763778539651776}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:19:48,529] Trial 16 finished with value: 0.2568188285119639 and parameters: {'alpha': 0.0027715792912402612, 'beta': 0.16907331327899683}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:20:07,900] Trial 17 finished with value: 0.2564688782726011 and parameters: {'alpha': 0.004621747120279302, 'beta': 0.37530429945905924}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:20:22,303] Trial 18 finished with value: 0.2542296906326522 and parameters: {'alpha': 6.279058403022471, 'beta': 1.0956363016742834}. Best is trial 0 with value: 0.2527242007191018.
[I 2022-11-24 18:20:25,646] Trial 19 finished with value: 0.2526681158545648 and parameters: {'alpha': 5.626134217645154, 'beta': 2.7454544971373878}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:20:27,880] Trial 20 finished with value: 0.25472454639657216 and parameters: {'alpha': 0.08464752118650208, 'beta': 4.797647164975902}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:20:48,100] Trial 21 finished with value: 0.26286229634341357 and parameters: {'alpha': 2.048786842059973, 'beta': 0.4765427094171938}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:20:52,309] Trial 22 finished with value: 0.2768172353024742 and parameters: {'alpha': 0.02057211282804333, 'beta': 4.546434603458829}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:20:59,914] Trial 23 finished with value: 0.25299289647380685 and parameters: {'alpha': 2.827119863378691, 'beta': 1.4292150753624187}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:21:21,083] Trial 24 finished with value: 0.2637345033842168 and parameters: {'alpha': 1.8061996480403677, 'beta': 0.4268588527339706}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:22:45,245] Trial 25 finished with value: 0.2737560189475227 and parameters: {'alpha': 1.0318388702507786, 'beta': 0.16544540131181923}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:23:05,536] Trial 26 finished with value: 0.8096281573466525 and parameters: {'alpha': 19.592984935090307, 'beta': 0.5695834926563906}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:23:10,623] Trial 27 finished with value: 0.2530493966398488 and parameters: {'alpha': 0.5316936849169218, 'beta': 1.1042713701840283}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:23:33,550] Trial 28 finished with value: 0.9247335462104506 and parameters: {'alpha': 5.399759418464485, 'beta': 0.16144039405874694}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:23:49,655] Trial 29 finished with value: 0.26940071174311764 and parameters: {'alpha': 13.086267625790393, 'beta': 0.9421635610321638}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:23:53,089] Trial 30 finished with value: 0.253377310216111 and parameters: {'alpha': 0.03327906240212909, 'beta': 0.15875530790219822}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:08,399] Trial 31 finished with value: 0.2564125118495248 and parameters: {'alpha': 0.005250231354598958, 'beta': 0.4313347727818434}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:22,695] Trial 32 finished with value: 0.27438246247704523 and parameters: {'alpha': 4.261034469964793, 'beta': 0.5763843386840125}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:32,177] Trial 33 finished with value: 0.25342618730620037 and parameters: {'alpha': 5.493074410388521, 'beta': 1.315989343722856}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:37,486] Trial 34 finished with value: 0.3408208788559141 and parameters: {'alpha': 0.007076769284349911, 'beta': 2.8883098926807356}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:41,565] Trial 35 finished with value: 0.25339034897425305 and parameters: {'alpha': 0.032823609345171284, 'beta': 0.3307016426809017}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:44,943] Trial 36 finished with value: 0.25312517140538826 and parameters: {'alpha': 0.38001421984655226, 'beta': 1.0191341403637415}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:24:47,356] Trial 37 finished with value: 0.2533650604656431 and parameters: {'alpha': 0.07289824476073294, 'beta': 0.386965286300693}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:14,449] Trial 38 finished with value: 0.278897770834106 and parameters: {'alpha': 0.00968346915845558, 'beta': 1.5717913936969359}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:17,604] Trial 39 finished with value: 0.2534278526863014 and parameters: {'alpha': 0.06847742876399489, 'beta': 0.15663167829781716}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:21,072] Trial 40 finished with value: 0.2527485289580103 and parameters: {'alpha': 1.6902251518427494, 'beta': 2.089520242289695}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:24,111] Trial 41 finished with value: 0.25936683021172574 and parameters: {'alpha': 0.03532682119517787, 'beta': 2.7566565226532833}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:38,644] Trial 42 finished with value: 0.25900499557526657 and parameters: {'alpha': 18.224865137117746, 'beta': 1.1932268083236992}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:41,050] Trial 43 finished with value: 0.2536174434199958 and parameters: {'alpha': 0.08627542933414853, 'beta': 1.756288374838106}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:45,397] Trial 44 finished with value: 0.25317352832627943 and parameters: {'alpha': 0.30383173886469117, 'beta': 1.022288537837637}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:49,106] Trial 45 finished with value: 0.25332274095215124 and parameters: {'alpha': 0.1829965621983082, 'beta': 2.5065331515988816}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:25:52,683] Trial 46 finished with value: 0.253547594045033 and parameters: {'alpha': 0.17725452764445346, 'beta': 0.3460982901291533}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:08,841] Trial 47 finished with value: 0.2902098140483192 and parameters: {'alpha': 0.010665256115836715, 'beta': 2.0848508739911176}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:24,654] Trial 48 finished with value: 1.1041182070425355 and parameters: {'alpha': 16.839388119779716, 'beta': 0.45734593857729955}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:26,853] Trial 49 finished with value: 0.2533673546683436 and parameters: {'alpha': 0.15910393769247955, 'beta': 2.45888195598381}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:41,176] Trial 50 finished with value: 0.48736451306410533 and parameters: {'alpha': 0.001492942043202645, 'beta': 1.8470059796611928}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:55,723] Trial 51 finished with value: 0.32522290351419614 and parameters: {'alpha': 0.0041066819577071844, 'beta': 1.3980200721868479}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:57,657] Trial 52 finished with value: 0.25478437843194823 and parameters: {'alpha': 0.4095309257625492, 'beta': 4.838304402884942}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:26:59,140] Trial 53 finished with value: 0.25402612852249834 and parameters: {'alpha': 0.1617137612777909, 'beta': 4.39713432495169}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:01,554] Trial 54 finished with value: 0.25342716727906117 and parameters: {'alpha': 0.10296736833223406, 'beta': 0.32621044582499953}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:16,022] Trial 55 finished with value: 0.26799049460937685 and parameters: {'alpha': 1.3624993311308726, 'beta': 0.2946335495764438}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:27,413] Trial 56 finished with value: 0.25363063864095275 and parameters: {'alpha': 4.576947125893015, 'beta': 1.1475134006220333}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:30,763] Trial 57 finished with value: 0.2534862622793274 and parameters: {'alpha': 0.03910693736220474, 'beta': 0.558113464538545}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:42,143] Trial 58 finished with value: 0.2562093312990398 and parameters: {'alpha': 0.7840639080146835, 'beta': 0.3845413667702614}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:44,983] Trial 59 finished with value: 0.2533104849880528 and parameters: {'alpha': 0.152989175493937, 'beta': 0.5581813113965772}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:27:47,363] Trial 60 finished with value: 0.25402635572770016 and parameters: {'alpha': 0.13961093537244096, 'beta': 0.10030576730290774}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:28:02,444] Trial 61 finished with value: 0.3702046544063613 and parameters: {'alpha': 3.8856826607215544, 'beta': 0.31592452089439}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:28:16,714] Trial 62 finished with value: 0.38783155625379684 and parameters: {'alpha': 0.0022085984561288075, 'beta': 1.3558976021627378}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:28:27,296] Trial 63 finished with value: 0.25324822867471725 and parameters: {'alpha': 14.32062740123356, 'beta': 1.6244206685012315}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:28:30,144] Trial 64 finished with value: 0.2534647524332305 and parameters: {'alpha': 0.04887763633830982, 'beta': 0.6683576056196328}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:28:44,297] Trial 65 finished with value: 0.26121175258455714 and parameters: {'alpha': 11.528278087773867, 'beta': 1.0109480494079153}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:28:58,437] Trial 66 finished with value: 0.2815284883534079 and parameters: {'alpha': 6.775440530762066, 'beta': 0.6713965378768966}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:12,470] Trial 67 finished with value: 0.3681142136346237 and parameters: {'alpha': 0.0010839766859912364, 'beta': 0.7275577787656944}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:14,335] Trial 68 finished with value: 0.25492357205912164 and parameters: {'alpha': 0.06734091055037464, 'beta': 3.224301353550378}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:28,473] Trial 69 finished with value: 0.31290935402120673 and parameters: {'alpha': 1.5581673371646798, 'beta': 0.13796321499749933}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:31,343] Trial 70 finished with value: 0.302524923974021 and parameters: {'alpha': 0.012169346969431538, 'beta': 3.656792050035746}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:33,732] Trial 71 finished with value: 0.25337106992036135 and parameters: {'alpha': 0.0671691514343524, 'beta': 0.625541437215295}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:39,431] Trial 72 finished with value: 0.25294029323174383 and parameters: {'alpha': 2.688866427246341, 'beta': 1.4881827304584554}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:29:53,647] Trial 73 finished with value: 1.0018413716016654 and parameters: {'alpha': 5.5571189949449336, 'beta': 0.15255295035556327}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:08,954] Trial 74 finished with value: 1.0222810760475944 and parameters: {'alpha': 5.839870617841071, 'beta': 0.16282687026425413}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:23,194] Trial 75 finished with value: 0.30479621792031086 and parameters: {'alpha': 0.0021914289526244663, 'beta': 0.7505791975466938}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:25,101] Trial 76 finished with value: 0.2533014665957588 and parameters: {'alpha': 0.21679221518512104, 'beta': 2.688227923493711}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:27,667] Trial 77 finished with value: 0.25347049907280483 and parameters: {'alpha': 0.08875895315137892, 'beta': 0.19401748245304087}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:29,110] Trial 78 finished with value: 0.25756961270471723 and parameters: {'alpha': 0.04891366624975377, 'beta': 4.290440886854022}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:31,469] Trial 79 finished with value: 0.2537109958745572 and parameters: {'alpha': 0.12080662474275447, 'beta': 0.15660748333357807}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:32,936] Trial 80 finished with value: 0.256746545139518 and parameters: {'alpha': 0.0549188573815378, 'beta': 4.70638722697531}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:39,689] Trial 81 finished with value: 0.25587079020337056 and parameters: {'alpha': 0.38718572253141026, 'beta': 0.21715973282108705}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:43,537] Trial 82 finished with value: 0.35757138025246904 and parameters: {'alpha': 0.006434473685211355, 'beta': 3.3161938161960802}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:51,272] Trial 83 finished with value: 0.2562946146494171 and parameters: {'alpha': 0.44488038718421674, 'beta': 0.23216760358375613}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:30:53,266] Trial 84 finished with value: 0.2549377351590416 and parameters: {'alpha': 0.0688004322543723, 'beta': 3.4208025123667007}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:07,597] Trial 85 finished with value: 0.3041697625960404 and parameters: {'alpha': 3.4717544643401683, 'beta': 0.39475142126384416}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:10,953] Trial 86 finished with value: 0.2534214810898123 and parameters: {'alpha': 0.029131998114047427, 'beta': 0.1358189401246806}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:13,329] Trial 87 finished with value: 0.25364668066010587 and parameters: {'alpha': 0.0780940641921909, 'beta': 1.7122410998947613}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:29,213] Trial 88 finished with value: 0.34246437676455754 and parameters: {'alpha': 0.00462601750932343, 'beta': 1.7689636115914795}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:37,806] Trial 89 finished with value: 0.2531586024828812 and parameters: {'alpha': 9.881941163127411, 'beta': 1.6353931359914116}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:42,618] Trial 90 finished with value: 0.25359505838927077 and parameters: {'alpha': 0.02366577276972881, 'beta': 0.4273815624589079}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:44,481] Trial 91 finished with value: 0.252992064301987 and parameters: {'alpha': 0.9973374689905776, 'beta': 3.172871271369056}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:31:55,139] Trial 92 finished with value: 0.2556349565184113 and parameters: {'alpha': 0.013291514103406933, 'beta': 0.808129202945686}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:01,133] Trial 93 finished with value: 0.43887075289253774 and parameters: {'alpha': 0.003186917455130655, 'beta': 3.0023291183039897}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:11,981] Trial 94 finished with value: 0.2554286036803571 and parameters: {'alpha': 0.7739486558540056, 'beta': 0.43397781024543824}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:26,323] Trial 95 finished with value: 0.2835931143678551 and parameters: {'alpha': 0.0010744370718597052, 'beta': 0.23082962917599067}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:40,150] Trial 96 finished with value: 0.2543180219891798 and parameters: {'alpha': 0.004430740853611055, 'beta': 0.15568325389780302}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:42,607] Trial 97 finished with value: 0.25291152113946747 and parameters: {'alpha': 0.8520805812856728, 'beta': 2.3552736905524387}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:57,204] Trial 98 finished with value: 0.2670141015277472 and parameters: {'alpha': 2.1833821694683873, 'beta': 0.4371703391128226}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:32:59,665] Trial 99 finished with value: 0.253453310097746 and parameters: {'alpha': 0.069880116811035, 'beta': 1.0423317686844935}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:02,950] Trial 100 finished with value: 0.25281949703403334 and parameters: {'alpha': 1.0798701874574412, 'beta': 2.2530187286146814}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:05,829] Trial 101 finished with value: 0.25279217643925067 and parameters: {'alpha': 1.248528050257197, 'beta': 2.3143768587309776}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:08,653] Trial 102 finished with value: 0.25281778514978426 and parameters: {'alpha': 1.1157963993109408, 'beta': 2.2083093811673087}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:11,952] Trial 103 finished with value: 0.2527678970969402 and parameters: {'alpha': 2.8792179432336082, 'beta': 2.1883900511992}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:15,290] Trial 104 finished with value: 0.2527314333845589 and parameters: {'alpha': 2.528895518810339, 'beta': 2.219894140150542}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:18,150] Trial 105 finished with value: 0.252825399609826 and parameters: {'alpha': 1.0457868989281518, 'beta': 2.245766149159365}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:21,447] Trial 106 finished with value: 0.25273105321288053 and parameters: {'alpha': 2.5957280682411548, 'beta': 2.229507866251224}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:24,316] Trial 107 finished with value: 0.2528139503646442 and parameters: {'alpha': 1.2734656059255947, 'beta': 2.1371675520398803}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:27,194] Trial 108 finished with value: 0.25283570454172394 and parameters: {'alpha': 1.1697364864694026, 'beta': 2.0610090478585246}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:30,544] Trial 109 finished with value: 0.2527072323061525 and parameters: {'alpha': 2.1390301533003013, 'beta': 2.2580551949235677}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:33,933] Trial 110 finished with value: 0.25276241534959654 and parameters: {'alpha': 2.05106485531615, 'beta': 2.0808290103856546}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:37,328] Trial 111 finished with value: 0.2527739695031797 and parameters: {'alpha': 2.1685401980801338, 'beta': 2.0709559929939765}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:41,144] Trial 112 finished with value: 0.25277998007781183 and parameters: {'alpha': 2.265687653344853, 'beta': 1.9155746896369952}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:44,981] Trial 113 finished with value: 0.25276411349495276 and parameters: {'alpha': 2.3014690043815804, 'beta': 1.9493050040528515}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:48,803] Trial 114 finished with value: 0.25280813393329843 and parameters: {'alpha': 2.3666978252909954, 'beta': 1.8870562605270724}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:52,172] Trial 115 finished with value: 0.2528028374142845 and parameters: {'alpha': 1.7289843941873733, 'beta': 1.944543125967709}. Best is trial 19 with value: 0.2526681158545648.
[I 2022-11-24 18:33:55,537] Trial 116 finished with value: 0.2526565489093982 and parameters: {'alpha': 3.193543943361365, 'beta': 2.5570722882786425}. Best is trial 116 with value: 0.2526565489093982.
[I 2022-11-24 18:33:59,422] Trial 117 finished with value: 0.2526560389425042 and parameters: {'alpha': 3.3370015860946394, 'beta': 2.5714662380944717}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:02,542] Trial 118 finished with value: 0.2527202643942217 and parameters: {'alpha': 3.1389111425412994, 'beta': 2.5876019043850778}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:05,901] Trial 119 finished with value: 0.25265933938020696 and parameters: {'alpha': 3.284832355159764, 'beta': 2.5501758070627094}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:09,775] Trial 120 finished with value: 0.25269697191291524 and parameters: {'alpha': 7.256668427098924, 'beta': 2.5698510267573944}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:13,203] Trial 121 finished with value: 0.2526725794739279 and parameters: {'alpha': 7.286643958741601, 'beta': 2.8544659844253393}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:17,041] Trial 122 finished with value: 0.25269972878549746 and parameters: {'alpha': 8.438347761119697, 'beta': 2.632550034731633}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:20,866] Trial 123 finished with value: 0.2526838785085432 and parameters: {'alpha': 9.176235787005636, 'beta': 2.7066349149774886}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:25,176] Trial 124 finished with value: 0.25266042807083217 and parameters: {'alpha': 9.837499564323288, 'beta': 2.626529275340256}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:29,006] Trial 125 finished with value: 0.2527342860443062 and parameters: {'alpha': 8.561478554918306, 'beta': 2.57532159226621}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:32,352] Trial 126 finished with value: 0.25267182512079595 and parameters: {'alpha': 7.440964693690846, 'beta': 2.8664571973191664}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:35,241] Trial 127 finished with value: 0.25273002574692555 and parameters: {'alpha': 7.757504699824805, 'beta': 3.77465237525183}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:38,110] Trial 128 finished with value: 0.2526715355845998 and parameters: {'alpha': 3.3135428342680298, 'beta': 2.863616700480811}. Best is trial 117 with value: 0.2526560389425042.
[I 2022-11-24 18:34:41,476] Trial 129 finished with value: 0.25263922559226737 and parameters: {'alpha': 4.836015947293784, 'beta': 2.8136846687126535}. Best is trial 129 with value: 0.25263922559226737.
[I 2022-11-24 18:34:44,861] Trial 130 finished with value: 0.2526365499468927 and parameters: {'alpha': 4.431663541958596, 'beta': 2.794745365114747}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:34:47,731] Trial 131 finished with value: 0.2527000073114417 and parameters: {'alpha': 4.502856313030932, 'beta': 2.832382499786807}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:34:50,615] Trial 132 finished with value: 0.2526890603827587 and parameters: {'alpha': 4.917350140577507, 'beta': 2.9296189979694662}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:34:53,961] Trial 133 finished with value: 0.25264082127644866 and parameters: {'alpha': 7.014779033956105, 'beta': 2.9845516107410317}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:34:57,794] Trial 134 finished with value: 0.25266209966051556 and parameters: {'alpha': 10.93082672366386, 'beta': 2.8797311059969046}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:01,624] Trial 135 finished with value: 0.25264227760435587 and parameters: {'alpha': 10.65133287036938, 'beta': 2.9302158313626823}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:04,492] Trial 136 finished with value: 0.25281434782976175 and parameters: {'alpha': 10.234465100092246, 'beta': 3.635414617049091}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:09,810] Trial 137 finished with value: 0.2604630882559448 and parameters: {'alpha': 13.71800719763809, 'beta': 3.0153075920556383}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:12,256] Trial 138 finished with value: 0.25508235597122964 and parameters: {'alpha': 3.716259732400208, 'beta': 3.9724990023951405}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:16,607] Trial 139 finished with value: 0.27601027246906257 and parameters: {'alpha': 16.47699151054013, 'beta': 3.447557763488239}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:19,517] Trial 140 finished with value: 0.25268296091923304 and parameters: {'alpha': 5.995369914247244, 'beta': 3.0859195282481875}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:22,923] Trial 141 finished with value: 0.25268041430889876 and parameters: {'alpha': 11.02236926412925, 'beta': 3.115751652635732}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:25,841] Trial 142 finished with value: 0.25267901838176654 and parameters: {'alpha': 6.6237295068596, 'beta': 3.1869749932072113}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:29,243] Trial 143 finished with value: 0.252669705607408 and parameters: {'alpha': 6.905314529442511, 'beta': 2.8397656317900055}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:32,646] Trial 144 finished with value: 0.25266525939584783 and parameters: {'alpha': 6.648846720631704, 'beta': 2.8384765733912176}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:35,560] Trial 145 finished with value: 0.25269795095890957 and parameters: {'alpha': 3.9280079548196616, 'beta': 2.7709011795769913}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:39,464] Trial 146 finished with value: 0.252683728231802 and parameters: {'alpha': 4.9828217952542095, 'beta': 2.4290330949920707}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:43,342] Trial 147 finished with value: 0.25271080346469416 and parameters: {'alpha': 12.278340924486907, 'beta': 2.834807812873891}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:46,274] Trial 148 finished with value: 0.25267423473201245 and parameters: {'alpha': 6.918495316638313, 'beta': 3.3852716445807918}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:49,183] Trial 149 finished with value: 0.25499353771388233 and parameters: {'alpha': 4.408074959377778, 'beta': 3.8919305994010567}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:52,116] Trial 150 finished with value: 0.25268971255010225 and parameters: {'alpha': 6.1734908915403635, 'beta': 3.574111716555656}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:55,028] Trial 151 finished with value: 0.25267464848821614 and parameters: {'alpha': 7.191364196049143, 'beta': 3.330222036094613}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:35:58,397] Trial 152 finished with value: 0.252702953483003 and parameters: {'alpha': 3.4174080848211097, 'beta': 2.4070402150493058}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:02,557] Trial 153 finished with value: 0.2526893416094155 and parameters: {'alpha': 9.067475644184972, 'beta': 2.912285157177755}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:07,320] Trial 154 finished with value: 0.2764818476708673 and parameters: {'alpha': 19.3472833675907, 'beta': 3.3648141182798534}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:11,275] Trial 155 finished with value: 0.25267141893710926 and parameters: {'alpha': 5.320173015066222, 'beta': 2.4896344688471364}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:16,050] Trial 156 finished with value: 0.252749149043521 and parameters: {'alpha': 14.870101740218086, 'beta': 2.5459900206512915}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:19,361] Trial 157 finished with value: 0.2526467436148912 and parameters: {'alpha': 5.235102047190435, 'beta': 2.805100000036853}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:22,630] Trial 158 finished with value: 0.25268175796525444 and parameters: {'alpha': 5.379172112529634, 'beta': 2.6771947742923405}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:25,477] Trial 159 finished with value: 0.25266524578065575 and parameters: {'alpha': 4.260917117041651, 'beta': 3.0253836794358167}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:28,773] Trial 160 finished with value: 0.25267997619553384 and parameters: {'alpha': 3.2760172647406915, 'beta': 2.4622823772862596}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:31,597] Trial 161 finished with value: 0.25266108743327015 and parameters: {'alpha': 4.1121618532121795, 'beta': 3.0772883660722425}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:34,409] Trial 162 finished with value: 0.25265996037642663 and parameters: {'alpha': 4.065105406037045, 'beta': 3.1080909993204022}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:37,693] Trial 163 finished with value: 0.25272245080309463 and parameters: {'alpha': 4.1401311579678595, 'beta': 2.443892353273096}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:40,704] Trial 164 finished with value: 0.2526628429646946 and parameters: {'alpha': 5.101078075367312, 'beta': 3.210839292743365}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:43,714] Trial 165 finished with value: 0.2526600278508923 and parameters: {'alpha': 4.235124401642272, 'beta': 3.130119247033531}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:46,602] Trial 166 finished with value: 0.25265981977006474 and parameters: {'alpha': 4.327094614819587, 'beta': 3.1570351600708544}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:49,004] Trial 167 finished with value: 0.25623506206664015 and parameters: {'alpha': 4.928790707091162, 'beta': 4.108540280797851}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:51,855] Trial 168 finished with value: 0.2536049513796826 and parameters: {'alpha': 3.5403092780831744, 'beta': 3.645674748195593}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:54,721] Trial 169 finished with value: 0.25266316311248227 and parameters: {'alpha': 4.248842376088104, 'beta': 3.053499158718998}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:36:57,687] Trial 170 finished with value: 0.25266253125519544 and parameters: {'alpha': 4.297531934518895, 'beta': 3.0713635739719516}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:00,127] Trial 171 finished with value: 0.2527248663446609 and parameters: {'alpha': 2.9471320453194805, 'beta': 3.0824537112003156}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:03,063] Trial 172 finished with value: 0.2526596236428455 and parameters: {'alpha': 4.0777418807717325, 'beta': 3.199150047485888}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:05,934] Trial 173 finished with value: 0.2526652265778967 and parameters: {'alpha': 4.125944050332573, 'beta': 3.3292545475242226}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:08,835] Trial 174 finished with value: 0.25266194869658204 and parameters: {'alpha': 4.953236564480262, 'beta': 3.256133752695039}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:11,394] Trial 175 finished with value: 0.25662570209316166 and parameters: {'alpha': 5.491970682093181, 'beta': 4.165180977725}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:13,812] Trial 176 finished with value: 0.25381432822926825 and parameters: {'alpha': 2.8145084478943607, 'beta': 3.7320451523450795}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:17,163] Trial 177 finished with value: 0.25266998068712315 and parameters: {'alpha': 11.172872802755613, 'beta': 3.2677146359127063}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:20,039] Trial 178 finished with value: 0.25269959552111637 and parameters: {'alpha': 9.09370159721325, 'beta': 3.5722621589619155}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:22,909] Trial 179 finished with value: 0.2526629893967982 and parameters: {'alpha': 3.5196780685590126, 'beta': 3.1976389262533753}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:26,254] Trial 180 finished with value: 0.2526924524890968 and parameters: {'alpha': 5.415706632584064, 'beta': 2.6489804062907867}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:29,147] Trial 181 finished with value: 0.25266056599292924 and parameters: {'alpha': 3.727520166079608, 'beta': 3.1818488033195504}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:32,028] Trial 182 finished with value: 0.25266475984338727 and parameters: {'alpha': 4.706856117654144, 'beta': 3.09381310148695}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:34,425] Trial 183 finished with value: 0.2544667888473845 and parameters: {'alpha': 3.127884651200684, 'beta': 3.8857069782872284}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:37,312] Trial 184 finished with value: 0.252847824785099 and parameters: {'alpha': 3.9138002632150473, 'beta': 3.4888636018636534}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:40,668] Trial 185 finished with value: 0.2527143314269005 and parameters: {'alpha': 5.999704230501169, 'beta': 2.6441229309613745}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:43,091] Trial 186 finished with value: 0.25272424188967585 and parameters: {'alpha': 2.793864333501141, 'beta': 3.152667066688655}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:46,458] Trial 187 finished with value: 0.25265433304160645 and parameters: {'alpha': 4.758773735198401, 'beta': 2.7211958303844863}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:50,285] Trial 188 finished with value: 0.25268090113427993 and parameters: {'alpha': 8.658396513439785, 'beta': 2.685770545198139}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:53,157] Trial 189 finished with value: 0.25266643658353016 and parameters: {'alpha': 3.847787294513571, 'beta': 2.963273283270931}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:55,701] Trial 190 finished with value: 0.2549828504619768 and parameters: {'alpha': 1.6823452189784105, 'beta': 4.493403405880404}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:37:58,876] Trial 191 finished with value: 0.2526699853479233 and parameters: {'alpha': 4.910445888683838, 'beta': 3.4224922451016484}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:02,732] Trial 192 finished with value: 0.2526739132443851 and parameters: {'alpha': 5.980881809410529, 'beta': 2.755098307460907}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:05,607] Trial 193 finished with value: 0.252659735175021 and parameters: {'alpha': 4.395486938251249, 'beta': 3.184966554376728}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:08,957] Trial 194 finished with value: 0.2527049035126544 and parameters: {'alpha': 3.1653234046956813, 'beta': 2.370952431117842}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:11,979] Trial 195 finished with value: 0.2526788986554302 and parameters: {'alpha': 4.304405651736297, 'beta': 2.9126307168998085}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:16,448] Trial 196 finished with value: 0.25270363830194553 and parameters: {'alpha': 11.854400426271878, 'beta': 2.649728266455312}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:19,300] Trial 197 finished with value: 0.2526615068091427 and parameters: {'alpha': 3.5526393002887455, 'beta': 3.0325742091773735}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:21,675] Trial 198 finished with value: 0.25346682649015295 and parameters: {'alpha': 2.656327460195642, 'beta': 3.643839551431717}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:25,914] Trial 199 finished with value: 0.2526813083390534 and parameters: {'alpha': 8.0444009948551, 'beta': 2.4908987299759118}. Best is trial 130 with value: 0.2526365499468927.
[I 2022-11-24 18:38:28,226] A new study created in memory with name: no-name-d08aa487-f37d-47f7-b8ae-a6d337c5a3f6
[I 2022-11-24 18:38:31,172] Trial 0 finished with value: 0.2534670365620439 and parameters: {'alpha': 0.05497630030044217, 'beta': 0.1756611384777792}. Best is trial 0 with value: 0.2534670365620439.
[I 2022-11-24 18:38:39,040] Trial 1 finished with value: 0.2560192693209475 and parameters: {'alpha': 0.009706132709416343, 'beta': 0.150258660296489}. Best is trial 0 with value: 0.2534670365620439.
[I 2022-11-24 18:38:40,341] Trial 2 finished with value: 0.5575104226760504 and parameters: {'alpha': 0.004506149475833665, 'beta': 4.922403428906079}. Best is trial 0 with value: 0.2534670365620439.
[I 2022-11-24 18:38:44,314] Trial 3 finished with value: 0.2537221108662565 and parameters: {'alpha': 0.035908983334730485, 'beta': 0.20145129601655065}. Best is trial 0 with value: 0.2534670365620439.
[I 2022-11-24 18:38:45,650] Trial 4 finished with value: 0.25264896286024213 and parameters: {'alpha': 5.164730336383545, 'beta': 3.0871213953905055}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:38:48,024] Trial 5 finished with value: 0.6213561560048781 and parameters: {'alpha': 0.001753903789950571, 'beta': 2.9144463744251725}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:38:51,378] Trial 6 finished with value: 0.2580073838803555 and parameters: {'alpha': 0.08280523297751066, 'beta': 1.5991673957275154}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:38:59,112] Trial 7 finished with value: 0.5889470399636045 and parameters: {'alpha': 0.0014262600668663063, 'beta': 1.4599306507329048}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:03,765] Trial 8 finished with value: 0.25374169817131415 and parameters: {'alpha': 0.030048007538134497, 'beta': 0.19370736761717805}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:05,319] Trial 9 finished with value: 0.26480476606709596 and parameters: {'alpha': 0.0879975828186863, 'beta': 2.9694597969378314}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:06,359] Trial 10 finished with value: 0.253236420874251 and parameters: {'alpha': 0.40816938295146454, 'beta': 0.5374123996647405}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:11,000] Trial 11 finished with value: 0.2674407693910362 and parameters: {'alpha': 0.05152770600057132, 'beta': 1.7288229771337886}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:12,052] Trial 12 finished with value: 0.2534265002294119 and parameters: {'alpha': 0.42147908361967396, 'beta': 0.10016908822739744}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:18,752] Trial 13 finished with value: 0.2542168685279612 and parameters: {'alpha': 0.01788943293579521, 'beta': 0.19402053782686612}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:20,046] Trial 14 finished with value: 0.25315055287553906 and parameters: {'alpha': 0.5250392359541179, 'beta': 0.6241469038706873}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:21,095] Trial 15 finished with value: 0.25289348615665425 and parameters: {'alpha': 2.305227050376148, 'beta': 3.174838318073153}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:22,137] Trial 16 finished with value: 0.645681387802132 and parameters: {'alpha': 0.0012720310690257862, 'beta': 4.599218911862045}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:29,861] Trial 17 finished with value: 0.3194422198372833 and parameters: {'alpha': 0.0017666648554925835, 'beta': 0.15946496980314734}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:30,901] Trial 18 finished with value: 0.42828497185520586 and parameters: {'alpha': 12.30739631855085, 'beta': 0.22565497819403324}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:32,453] Trial 19 finished with value: 0.2530105111979359 and parameters: {'alpha': 1.115796176179644, 'beta': 0.931826972247481}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:33,746] Trial 20 finished with value: 0.25351190579771027 and parameters: {'alpha': 0.24640324937671526, 'beta': 1.4928602599479457}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:41,461] Trial 21 finished with value: 0.394844000516606 and parameters: {'alpha': 0.009754502271440276, 'beta': 1.7741524104900366}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:47,675] Trial 22 finished with value: 0.507174204847782 and parameters: {'alpha': 0.004814193683273796, 'beta': 2.1010069748100793}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:55,386] Trial 23 finished with value: 0.5169460992389748 and parameters: {'alpha': 0.0011070569301857595, 'beta': 0.7332328740891678}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:56,172] Trial 24 finished with value: 0.2536029641996275 and parameters: {'alpha': 0.4500173149778049, 'beta': 4.035727724528911}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:57,519] Trial 25 finished with value: 0.25326218269506556 and parameters: {'alpha': 0.19223642280090994, 'beta': 0.1639298246159888}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:39:59,139] Trial 26 finished with value: 0.2526653334257008 and parameters: {'alpha': 4.974743728939755, 'beta': 2.489996152066001}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:07,358] Trial 27 finished with value: 0.260765723947951 and parameters: {'alpha': 11.46013806822758, 'beta': 0.4727133892357182}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:08,623] Trial 28 finished with value: 0.2806847187934777 and parameters: {'alpha': 0.06018555818455383, 'beta': 3.981764762992453}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:10,764] Trial 29 finished with value: 0.25360993609451893 and parameters: {'alpha': 1.1034496244152319, 'beta': 0.31232111437267657}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:15,167] Trial 30 finished with value: 0.25368899672079986 and parameters: {'alpha': 0.030782027436215338, 'beta': 0.16321817598935587}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:22,956] Trial 31 finished with value: 0.2845624883239573 and parameters: {'alpha': 0.0026037192190010694, 'beta': 0.10627868190316625}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:30,723] Trial 32 finished with value: 0.257767764608833 and parameters: {'alpha': 0.009136537000635337, 'beta': 0.21201648157578548}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:31,512] Trial 33 finished with value: 0.2537861347673238 and parameters: {'alpha': 0.35422486041213885, 'beta': 3.6935451490928934}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:39,257] Trial 34 finished with value: 0.2653786042874912 and parameters: {'alpha': 0.004830753153995619, 'beta': 0.14043037393618524}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:43,397] Trial 35 finished with value: 0.25381837943094804 and parameters: {'alpha': 9.711666631659094, 'beta': 0.9285819709375385}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:51,176] Trial 36 finished with value: 0.2895128775913364 and parameters: {'alpha': 13.631011579819406, 'beta': 0.29598165924115616}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:40:59,019] Trial 37 finished with value: 0.26013356885317696 and parameters: {'alpha': 0.007608160860885186, 'beta': 0.21519170165799803}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:06,786] Trial 38 finished with value: 0.27868296624091005 and parameters: {'alpha': 0.004809949640125445, 'beta': 0.3160845884147156}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:08,334] Trial 39 finished with value: 0.25856173529603527 and parameters: {'alpha': 0.11942523100158225, 'beta': 2.583473754213515}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:16,076] Trial 40 finished with value: 0.5532752530939502 and parameters: {'alpha': 0.002689453638580879, 'beta': 1.7876179687943734}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:16,861] Trial 41 finished with value: 0.25351753663773874 and parameters: {'alpha': 1.0386586841978507, 'beta': 4.342438051603685}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:18,726] Trial 42 finished with value: 0.48981594016873375 and parameters: {'alpha': 0.007693316935231868, 'beta': 3.6928169447794623}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:23,930] Trial 43 finished with value: 0.2553310949398415 and parameters: {'alpha': 4.669079606291165, 'beta': 0.46973915037433084}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:25,028] Trial 44 finished with value: 0.2537558331940234 and parameters: {'alpha': 2.3582408553505982, 'beta': 4.586914754634721}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:32,037] Trial 45 finished with value: 0.2570470642123678 and parameters: {'alpha': 6.031346435998778, 'beta': 0.4090573340430252}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:33,088] Trial 46 finished with value: 0.25413099240256315 and parameters: {'alpha': 2.7661349934744193, 'beta': 4.955652553852878}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:40,870] Trial 47 finished with value: 0.2790040925500494 and parameters: {'alpha': 0.022544524025008974, 'beta': 1.217130657996185}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:42,196] Trial 48 finished with value: 0.2529975001798396 and parameters: {'alpha': 1.0413090272761236, 'beta': 1.4301000279050935}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:50,146] Trial 49 finished with value: 0.29508885537424645 and parameters: {'alpha': 0.002980905410511616, 'beta': 0.24306758556643776}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:54,606] Trial 50 finished with value: 0.2539122989675921 and parameters: {'alpha': 0.06667121610791032, 'beta': 0.6093033920286043}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:55,715] Trial 51 finished with value: 0.2537899874912812 and parameters: {'alpha': 3.365562900629155, 'beta': 4.403090497121492}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:41:59,762] Trial 52 finished with value: 0.2538703540596423 and parameters: {'alpha': 0.05789740224950386, 'beta': 0.5228219981985786}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:08,315] Trial 53 finished with value: 0.3687694086357399 and parameters: {'alpha': 13.263223886504473, 'beta': 0.14895696776284922}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:08,987] Trial 54 finished with value: 0.2533016036802631 and parameters: {'alpha': 0.4712047691869582, 'beta': 2.2688036295724574}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:10,289] Trial 55 finished with value: 0.25485119850511334 and parameters: {'alpha': 0.1737879197564635, 'beta': 2.13453373482056}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:15,187] Trial 56 finished with value: 0.2557661594636885 and parameters: {'alpha': 0.04770839553384199, 'beta': 0.8716354884613221}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:21,821] Trial 57 finished with value: 0.34186033751918876 and parameters: {'alpha': 11.537286272142179, 'beta': 0.13872069968058787}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:27,877] Trial 58 finished with value: 0.25490880428706203 and parameters: {'alpha': 12.785147357884968, 'beta': 0.7653174815224724}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:28,998] Trial 59 finished with value: 0.2532666118345418 and parameters: {'alpha': 0.5943149692969821, 'beta': 0.3887393406103097}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:30,571] Trial 60 finished with value: 0.2532632587132098 and parameters: {'alpha': 0.11669640389822941, 'beta': 0.15970412905913306}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:32,552] Trial 61 finished with value: 0.2533078562276168 and parameters: {'alpha': 0.07701140404815429, 'beta': 0.12366830788703052}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:34,327] Trial 62 finished with value: 0.28573736580595277 and parameters: {'alpha': 0.04924683447724989, 'beta': 3.020719637348886}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:35,447] Trial 63 finished with value: 0.25277896554519036 and parameters: {'alpha': 4.085488967434653, 'beta': 3.52065109451287}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:42,156] Trial 64 finished with value: 0.49657769057460194 and parameters: {'alpha': 0.0013154978097173707, 'beta': 0.7346558284601329}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:44,055] Trial 65 finished with value: 0.2527797295554524 and parameters: {'alpha': 4.417487902970161, 'beta': 1.5045954334534222}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:50,563] Trial 66 finished with value: 0.2810871628699442 and parameters: {'alpha': 19.08952622804021, 'beta': 0.4289607994314429}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:53,111] Trial 67 finished with value: 0.2534779345754405 and parameters: {'alpha': 0.045873201430283894, 'beta': 0.11591200299784434}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:42:59,804] Trial 68 finished with value: 0.2963637566383233 and parameters: {'alpha': 0.021899530923214054, 'beta': 1.5087711341742722}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:03,210] Trial 69 finished with value: 0.2548212625752001 and parameters: {'alpha': 0.07437300970408531, 'beta': 0.9848678168711394}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:15,612] Trial 70 finished with value: 0.34673952104915456 and parameters: {'alpha': 12.042161193142814, 'beta': 0.14531173085264237}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:28,072] Trial 71 finished with value: 0.39043829069271907 and parameters: {'alpha': 0.0010842811110882678, 'beta': 0.23487227674719924}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:30,320] Trial 72 finished with value: 0.25421789046888577 and parameters: {'alpha': 0.1444448483328852, 'beta': 1.3885690523095942}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:32,799] Trial 73 finished with value: 0.252707189736175 and parameters: {'alpha': 18.142429694438405, 'beta': 2.1271099241527702}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:36,235] Trial 74 finished with value: 0.4548733572263091 and parameters: {'alpha': 0.009665378361358171, 'beta': 3.239545134983169}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:39,969] Trial 75 finished with value: 0.25420756348779366 and parameters: {'alpha': 3.405129260709461, 'beta': 0.540197952124638}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:42,044] Trial 76 finished with value: 0.32624669618835705 and parameters: {'alpha': 0.02983497995623204, 'beta': 3.596063191366966}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:43,745] Trial 77 finished with value: 0.25308332559518615 and parameters: {'alpha': 0.8324596275325206, 'beta': 0.6894277434780762}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:45,711] Trial 78 finished with value: 0.2528112780198429 and parameters: {'alpha': 2.7455633736511937, 'beta': 1.354199202287898}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:47,642] Trial 79 finished with value: 0.25266556788507294 and parameters: {'alpha': 6.7028787613259375, 'beta': 1.8700848793612754}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:50,029] Trial 80 finished with value: 0.25415639986627603 and parameters: {'alpha': 1.6041634959830078, 'beta': 0.3235441023589593}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:43:57,177] Trial 81 finished with value: 0.26243829541820557 and parameters: {'alpha': 14.778362380604984, 'beta': 0.5148664350488654}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:00,082] Trial 82 finished with value: 0.2544645518603711 and parameters: {'alpha': 0.13723869936077535, 'beta': 1.4326652916267268}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:07,599] Trial 83 finished with value: 0.2951475987426453 and parameters: {'alpha': 0.0022717000226663976, 'beta': 0.12763238134261934}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:08,550] Trial 84 finished with value: 0.252853168961548 and parameters: {'alpha': 2.475575621434246, 'beta': 2.5803757489440686}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:17,718] Trial 85 finished with value: 0.4181582560635876 and parameters: {'alpha': 0.0010056664182030873, 'beta': 0.2981664964171168}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:21,665] Trial 86 finished with value: 0.26202591502503514 and parameters: {'alpha': 17.998584284412498, 'beta': 3.810582432009261}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:24,135] Trial 87 finished with value: 0.2572085016424843 and parameters: {'alpha': 2.213666468992301, 'beta': 0.12207038649818955}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:27,724] Trial 88 finished with value: 0.2536104801047966 and parameters: {'alpha': 0.04029370762962972, 'beta': 0.19067122675393386}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:31,733] Trial 89 finished with value: 0.2532294214611584 and parameters: {'alpha': 13.089781018870987, 'beta': 1.1880416697631522}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:33,242] Trial 90 finished with value: 0.2530181341123487 and parameters: {'alpha': 1.0140768733608303, 'beta': 1.2498987477606864}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:40,535] Trial 91 finished with value: 0.2907934112927879 and parameters: {'alpha': 0.009884207255154157, 'beta': 0.8044618102766162}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:47,799] Trial 92 finished with value: 0.3730778411736796 and parameters: {'alpha': 0.0014132085543595598, 'beta': 0.2880422062976086}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:48,767] Trial 93 finished with value: 0.2537007018244132 and parameters: {'alpha': 1.9938252599025017, 'beta': 4.583780120935355}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:50,953] Trial 94 finished with value: 0.2533183483697856 and parameters: {'alpha': 0.08778472760457458, 'beta': 0.1502301894319799}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:52,008] Trial 95 finished with value: 0.25349299104930506 and parameters: {'alpha': 0.49821422516579733, 'beta': 0.13047766599791646}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:44:59,257] Trial 96 finished with value: 0.5385264204115698 and parameters: {'alpha': 0.002333733534291725, 'beta': 1.4270366895621667}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:45:06,444] Trial 97 finished with value: 0.3278577162591501 and parameters: {'alpha': 0.005642232028042039, 'beta': 0.7653155739333868}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:45:10,214] Trial 98 finished with value: 0.2542841173568016 and parameters: {'alpha': 5.23577302205337, 'beta': 0.6632497817549552}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:45:12,834] Trial 99 finished with value: 0.25334396403197124 and parameters: {'alpha': 3.4038836246872397, 'beta': 0.7869438612838479}. Best is trial 4 with value: 0.25264896286024213.
[I 2022-11-24 18:45:14,558] Trial 100 finished with value: 0.25257189509978983 and parameters: {'alpha': 8.21203616276321, 'beta': 2.5023138751202056}. Best is trial 100 with value: 0.25257189509978983.
[I 2022-11-24 18:45:16,051] Trial 101 finished with value: 0.2526190971991026 and parameters: {'alpha': 7.634365119501262, 'beta': 2.614873469675397}. Best is trial 100 with value: 0.25257189509978983.
[I 2022-11-24 18:45:21,154] Trial 102 finished with value: 0.2525696854813265 and parameters: {'alpha': 8.048120055647676, 'beta': 2.522136005757565}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:22,720] Trial 103 finished with value: 0.25262296251793065 and parameters: {'alpha': 6.96106172967727, 'beta': 2.59671886067235}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:24,899] Trial 104 finished with value: 0.25262640013807797 and parameters: {'alpha': 8.89291779776771, 'beta': 1.911348725663835}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:26,843] Trial 105 finished with value: 0.25266229643524996 and parameters: {'alpha': 8.076955883353676, 'beta': 1.9336632922558636}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:28,785] Trial 106 finished with value: 0.25268632895997295 and parameters: {'alpha': 8.222037771091351, 'beta': 1.8853174420217993}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:30,722] Trial 107 finished with value: 0.25263869083616813 and parameters: {'alpha': 7.69233600181117, 'beta': 1.9820278605164272}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:32,681] Trial 108 finished with value: 0.2526712089224814 and parameters: {'alpha': 7.735638099538468, 'beta': 1.8976036307303488}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:34,395] Trial 109 finished with value: 0.2525909594934125 and parameters: {'alpha': 6.925072860578833, 'beta': 2.4030861509278716}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:35,898] Trial 110 finished with value: 0.25262324794503566 and parameters: {'alpha': 6.251304483437819, 'beta': 2.642903741069497}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:37,455] Trial 111 finished with value: 0.2526136948945724 and parameters: {'alpha': 6.789203298219802, 'beta': 2.6703831373146127}. Best is trial 102 with value: 0.2525696854813265.
[I 2022-11-24 18:45:39,167] Trial 112 finished with value: 0.2525693353478116 and parameters: {'alpha': 9.840947223716126, 'beta': 2.6191795133156033}. Best is trial 112 with value: 0.2525693353478116.
[I 2022-11-24 18:45:40,866] Trial 113 finished with value: 0.25256583390232046 and parameters: {'alpha': 9.727929331157124, 'beta': 2.739314029119068}. Best is trial 113 with value: 0.25256583390232046.
[I 2022-11-24 18:45:42,601] Trial 114 finished with value: 0.2525580307408351 and parameters: {'alpha': 9.764059159127179, 'beta': 2.7643886578437646}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:44,098] Trial 115 finished with value: 0.25262533996109415 and parameters: {'alpha': 5.70234127866969, 'beta': 2.7842308458961553}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:45,607] Trial 116 finished with value: 0.252621077621828 and parameters: {'alpha': 5.8741562552508455, 'beta': 2.77355453693376}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:47,126] Trial 117 finished with value: 0.25261937720950045 and parameters: {'alpha': 6.106673102406567, 'beta': 2.713677008545931}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:49,142] Trial 118 finished with value: 0.2525809302537797 and parameters: {'alpha': 10.00180230197054, 'beta': 2.2629843350850436}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:50,884] Trial 119 finished with value: 0.25262135615701614 and parameters: {'alpha': 9.830193234368423, 'beta': 2.3481526659491863}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:52,676] Trial 120 finished with value: 0.2525952862912758 and parameters: {'alpha': 9.485237696449278, 'beta': 2.429637655175271}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:54,656] Trial 121 finished with value: 0.2525738681399224 and parameters: {'alpha': 10.136837835509583, 'beta': 2.3015846289947546}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:56,405] Trial 122 finished with value: 0.2526413438265506 and parameters: {'alpha': 9.971185262923713, 'beta': 2.313178569540156}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:45:58,372] Trial 123 finished with value: 0.25460688282138905 and parameters: {'alpha': 15.898195233422767, 'beta': 3.26873365924678}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:01,059] Trial 124 finished with value: 0.25260682466913864 and parameters: {'alpha': 10.29222570820621, 'beta': 2.8851864100568654}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:03,597] Trial 125 finished with value: 0.2526396857531673 and parameters: {'alpha': 10.472267505148501, 'beta': 2.9786106597963844}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:05,567] Trial 126 finished with value: 0.2527173242984087 and parameters: {'alpha': 3.985962558612528, 'beta': 1.6529784706119912}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:07,326] Trial 127 finished with value: 0.2526772934414559 and parameters: {'alpha': 4.8964525995922195, 'beta': 2.4033384954742787}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:09,050] Trial 128 finished with value: 0.25483599674496005 and parameters: {'alpha': 15.633895972644911, 'beta': 3.332151184446856}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:10,990] Trial 129 finished with value: 0.2526222302956315 and parameters: {'alpha': 10.734721204530935, 'beta': 2.162473223053182}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:12,916] Trial 130 finished with value: 0.25291887520377204 and parameters: {'alpha': 19.980930066682003, 'beta': 2.8631235396621504}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:19,302] Trial 131 finished with value: 0.25261349036774333 and parameters: {'alpha': 6.25870040181532, 'beta': 2.753800320831031}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:26,163] Trial 132 finished with value: 0.25258574171605663 and parameters: {'alpha': 8.885256975693386, 'beta': 2.4598401638221854}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:27,873] Trial 133 finished with value: 0.2525834004026528 and parameters: {'alpha': 9.362711770386698, 'beta': 2.4646146092297383}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:29,392] Trial 134 finished with value: 0.252713012278829 and parameters: {'alpha': 11.388643073171274, 'beta': 3.049582746522018}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:30,898] Trial 135 finished with value: 0.25262518242764737 and parameters: {'alpha': 8.604793000691584, 'beta': 2.275303853681091}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:32,676] Trial 136 finished with value: 0.2526617314258868 and parameters: {'alpha': 14.326036161466755, 'beta': 2.439912520635601}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:34,418] Trial 137 finished with value: 0.2526133841477407 and parameters: {'alpha': 9.320756997741386, 'beta': 2.1199138360779552}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:36,260] Trial 138 finished with value: 0.2526474601586412 and parameters: {'alpha': 9.547763839447626, 'beta': 2.0339857008399598}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:38,100] Trial 139 finished with value: 0.2526499780147254 and parameters: {'alpha': 11.957972021238856, 'beta': 2.1712778124889227}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:40,033] Trial 140 finished with value: 0.252692651039772 and parameters: {'alpha': 4.5682827780128, 'beta': 1.7355554475388295}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:41,546] Trial 141 finished with value: 0.2525852386299042 and parameters: {'alpha': 6.984900810337228, 'beta': 2.4403629499683}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:43,479] Trial 142 finished with value: 0.2525888649183921 and parameters: {'alpha': 9.711724673469696, 'beta': 2.448006675663003}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:45,384] Trial 143 finished with value: 0.25271915464233363 and parameters: {'alpha': 16.146714913068376, 'beta': 2.367472346349892}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:46,817] Trial 144 finished with value: 0.2525846537439344 and parameters: {'alpha': 8.680831754197365, 'beta': 3.086193579520733}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:48,262] Trial 145 finished with value: 0.2526845285012215 and parameters: {'alpha': 12.607475771822669, 'beta': 3.118839834584318}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:49,297] Trial 146 finished with value: 0.2527730226044275 and parameters: {'alpha': 3.912306322270509, 'beta': 3.38606742295232}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:51,230] Trial 147 finished with value: 0.25257554943694505 and parameters: {'alpha': 8.542239911859946, 'beta': 2.499443851957429}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:52,602] Trial 148 finished with value: 0.25352014828067837 and parameters: {'alpha': 7.422345928966748, 'beta': 4.031476586876303}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:54,032] Trial 149 finished with value: 0.2526697395678963 and parameters: {'alpha': 4.843495069783865, 'beta': 2.4821811330830714}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:56,013] Trial 150 finished with value: 0.2526886472881619 and parameters: {'alpha': 13.283734323291572, 'beta': 2.4332285104411726}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:57,365] Trial 151 finished with value: 0.2525924146173313 and parameters: {'alpha': 8.850510560279673, 'beta': 2.9652595219012867}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:46:58,659] Trial 152 finished with value: 0.2525766571022616 and parameters: {'alpha': 9.01950050314149, 'beta': 2.994593028890978}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:01,167] Trial 153 finished with value: 0.2525771165178248 and parameters: {'alpha': 7.9817122457131235, 'beta': 3.0463760285898576}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:02,593] Trial 154 finished with value: 0.2526045974582641 and parameters: {'alpha': 7.119458034354449, 'beta': 3.488381744450953}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:04,094] Trial 155 finished with value: 0.2526359840171072 and parameters: {'alpha': 5.437096933714292, 'beta': 3.0633450215412545}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:06,290] Trial 156 finished with value: 0.25261691827507815 and parameters: {'alpha': 11.62334443480771, 'beta': 2.2560815769595566}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:07,563] Trial 157 finished with value: 0.25258972559937154 and parameters: {'alpha': 7.9921558890569235, 'beta': 2.8272401695311618}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:09,002] Trial 158 finished with value: 0.25468851757853056 and parameters: {'alpha': 15.135670035765774, 'beta': 3.8094687348313885}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:10,767] Trial 159 finished with value: 0.2525594433011346 and parameters: {'alpha': 8.251836717861078, 'beta': 2.5971605694390023}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:11,993] Trial 160 finished with value: 0.2526386606017752 and parameters: {'alpha': 5.463756282288024, 'beta': 3.1502591976881416}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:13,452] Trial 161 finished with value: 0.25256656326528787 and parameters: {'alpha': 8.735470930278895, 'beta': 2.5827927868632505}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:15,060] Trial 162 finished with value: 0.252684815841181 and parameters: {'alpha': 11.11257011274412, 'beta': 2.575048032497143}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:16,736] Trial 163 finished with value: 0.25256066014217204 and parameters: {'alpha': 8.708455992281017, 'beta': 2.637201063630774}. Best is trial 114 with value: 0.2525580307408351.
[I 2022-11-24 18:47:18,293] Trial 164 finished with value: 0.25255561447005276 and parameters: {'alpha': 8.154332397824241, 'beta': 2.653091061604532}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:19,681] Trial 165 finished with value: 0.2526012274143077 and parameters: {'alpha': 6.8791594581738345, 'beta': 2.7848650779792608}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:21,228] Trial 166 finished with value: 0.2544334928919876 and parameters: {'alpha': 13.92850079952586, 'beta': 3.315945165096964}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:22,888] Trial 167 finished with value: 0.2526199334864763 and parameters: {'alpha': 7.977330077588896, 'beta': 2.0486082181058216}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:24,048] Trial 168 finished with value: 0.2526309438241987 and parameters: {'alpha': 5.845076240957285, 'beta': 2.6361683066615957}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:26,872] Trial 169 finished with value: 0.2527973401986833 and parameters: {'alpha': 17.416932793379132, 'beta': 2.223286666967541}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:28,461] Trial 170 finished with value: 0.2527602320202969 and parameters: {'alpha': 3.750548707956904, 'beta': 2.9577801750900923}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:31,508] Trial 171 finished with value: 0.25255914975521215 and parameters: {'alpha': 8.950591900189805, 'beta': 2.587069279425501}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:33,382] Trial 172 finished with value: 0.2538021904009383 and parameters: {'alpha': 0.29352559473262096, 'beta': 2.6750196161391155}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:35,096] Trial 173 finished with value: 0.25315882243196663 and parameters: {'alpha': 11.333361440794686, 'beta': 3.1388646848220865}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:36,458] Trial 174 finished with value: 0.25258528450871687 and parameters: {'alpha': 8.153886220519238, 'beta': 2.8752375112033293}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:37,633] Trial 175 finished with value: 0.2526509699936815 and parameters: {'alpha': 6.936756890639682, 'beta': 3.617254875600058}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:39,303] Trial 176 finished with value: 0.2527356347726209 and parameters: {'alpha': 13.59869790173509, 'beta': 2.5360268377730284}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:41,028] Trial 177 finished with value: 0.2526307719863314 and parameters: {'alpha': 9.303103265686424, 'beta': 2.2919502047126654}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:43,309] Trial 178 finished with value: 0.25266540887412964 and parameters: {'alpha': 5.462192453422785, 'beta': 2.0592436891943717}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:45,413] Trial 179 finished with value: 0.2525712684995411 and parameters: {'alpha': 10.635036367910665, 'beta': 2.760563342177101}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:47,810] Trial 180 finished with value: 0.2531428307532631 and parameters: {'alpha': 11.225827191500144, 'beta': 3.242626350515432}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:49,555] Trial 181 finished with value: 0.25260061067036294 and parameters: {'alpha': 8.440863181888284, 'beta': 2.7438777414719144}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:51,679] Trial 182 finished with value: 0.25259655005617765 and parameters: {'alpha': 6.745544110754058, 'beta': 2.9064905339799685}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:53,532] Trial 183 finished with value: 0.25257857207479095 and parameters: {'alpha': 10.508369723272349, 'beta': 2.5694219198642414}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:55,563] Trial 184 finished with value: 0.25259915001971406 and parameters: {'alpha': 10.450452693065168, 'beta': 2.600230098676192}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:47:57,491] Trial 185 finished with value: 0.25268955614519806 and parameters: {'alpha': 13.4318862964778, 'beta': 2.2353811951279807}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:00,248] Trial 186 finished with value: 0.25270376545366985 and parameters: {'alpha': 10.22840614753676, 'beta': 3.4728416810122607}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:03,306] Trial 187 finished with value: 0.25311032124304467 and parameters: {'alpha': 19.7744865368841, 'beta': 2.995805348642474}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:05,687] Trial 188 finished with value: 0.2527515373306686 and parameters: {'alpha': 15.714712628106591, 'beta': 2.702965785069827}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:07,939] Trial 189 finished with value: 0.2525730811599283 and parameters: {'alpha': 8.649566627666099, 'beta': 2.523363673471594}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:09,539] Trial 190 finished with value: 0.2526499814139854 and parameters: {'alpha': 4.7464575701720655, 'beta': 2.200062002420531}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:11,057] Trial 191 finished with value: 0.2525728074435939 and parameters: {'alpha': 8.56349159493491, 'beta': 2.5196892561452215}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:13,623] Trial 192 finished with value: 0.25271820456566463 and parameters: {'alpha': 11.581442073107333, 'beta': 2.5491632271398945}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:15,565] Trial 193 finished with value: 0.2526066749427518 and parameters: {'alpha': 8.503474494370762, 'beta': 2.3397592338243207}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:16,830] Trial 194 finished with value: 0.2526127726349846 and parameters: {'alpha': 6.4283175165048, 'beta': 2.7246498836998825}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:18,344] Trial 195 finished with value: 0.2526603826853886 and parameters: {'alpha': 12.540306030682025, 'beta': 2.5624062388092153}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:19,559] Trial 196 finished with value: 0.2525918513284845 and parameters: {'alpha': 9.340151221616518, 'beta': 2.8544456827396227}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:21,229] Trial 197 finished with value: 0.2525969235727234 and parameters: {'alpha': 7.7303963276896415, 'beta': 2.1210058712992437}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:22,868] Trial 198 finished with value: 0.25261505834987585 and parameters: {'alpha': 10.63601250039205, 'beta': 2.431943535779308}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:24,416] Trial 199 finished with value: 0.2526174022726381 and parameters: {'alpha': 5.4839855988530255, 'beta': 2.339884575691367}. Best is trial 164 with value: 0.25255561447005276.
[I 2022-11-24 18:48:26,447] A new study created in memory with name: no-name-470a3703-6a94-40fe-ac73-0b823b731dfa
[I 2022-11-24 18:48:28,097] Trial 0 finished with value: 0.25936899945239467 and parameters: {'alpha': 0.8547676633463782, 'beta': 1.977091794170675}. Best is trial 0 with value: 0.25936899945239467.
[I 2022-11-24 18:48:32,888] Trial 1 finished with value: 0.6044255432734187 and parameters: {'alpha': 0.0018968814677051454, 'beta': 0.32789618429355244}. Best is trial 0 with value: 0.25936899945239467.
[I 2022-11-24 18:48:34,521] Trial 2 finished with value: 0.25336839019713053 and parameters: {'alpha': 0.6181147700953705, 'beta': 0.12670064313971313}. Best is trial 2 with value: 0.25336839019713053.
[I 2022-11-24 18:48:39,816] Trial 3 finished with value: 0.34897128785766546 and parameters: {'alpha': 0.015575121190824558, 'beta': 0.2538500116100703}. Best is trial 2 with value: 0.25336839019713053.
[I 2022-11-24 18:48:40,706] Trial 4 finished with value: 0.2532944064630071 and parameters: {'alpha': 2.370144641934152, 'beta': 0.8294385191378648}. Best is trial 4 with value: 0.2532944064630071.
[I 2022-11-24 18:48:42,014] Trial 5 finished with value: 0.253157629064082 and parameters: {'alpha': 6.821786460631466, 'beta': 0.6920497123990746}. Best is trial 5 with value: 0.253157629064082.
[I 2022-11-24 18:48:47,176] Trial 6 finished with value: 0.5024026368017135 and parameters: {'alpha': 0.0036553403623777177, 'beta': 0.16314025216231826}. Best is trial 5 with value: 0.253157629064082.
[I 2022-11-24 18:48:52,212] Trial 7 finished with value: 0.4231232669054335 and parameters: {'alpha': 0.013097312851326396, 'beta': 0.45598343583593287}. Best is trial 5 with value: 0.253157629064082.
[I 2022-11-24 18:48:53,677] Trial 8 finished with value: 0.25406802648470045 and parameters: {'alpha': 1.221518443758327, 'beta': 1.1377228244511797}. Best is trial 5 with value: 0.253157629064082.
[I 2022-11-24 18:49:00,544] Trial 9 finished with value: 0.28037098062992427 and parameters: {'alpha': 0.16882506745434056, 'beta': 1.0497126435024364}. Best is trial 5 with value: 0.253157629064082.
[I 2022-11-24 18:49:06,689] Trial 10 finished with value: 0.5027319076801464 and parameters: {'alpha': 0.004039826864706634, 'beta': 0.20692737239418016}. Best is trial 5 with value: 0.253157629064082.
[I 2022-11-24 18:49:07,730] Trial 11 finished with value: 0.2530997272200076 and parameters: {'alpha': 9.843939563688748, 'beta': 1.2700607474272823}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:13,369] Trial 12 finished with value: 0.26778021595465007 and parameters: {'alpha': 0.2140743432840491, 'beta': 0.96865325471029}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:19,770] Trial 13 finished with value: 0.6484265274831448 and parameters: {'alpha': 0.0010073660247051904, 'beta': 0.3959010145278667}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:21,038] Trial 14 finished with value: 0.25325558223775557 and parameters: {'alpha': 2.8287344346248644, 'beta': 0.9489421543370723}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:27,818] Trial 15 finished with value: 0.2794037909722004 and parameters: {'alpha': 0.044535427629889004, 'beta': 0.30682779801521165}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:34,385] Trial 16 finished with value: 0.617275690581982 and parameters: {'alpha': 0.0012822426217355522, 'beta': 0.2367853145119525}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:39,717] Trial 17 finished with value: 0.4906337510298274 and parameters: {'alpha': 0.01020847181493873, 'beta': 0.5935837259381597}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:46,251] Trial 18 finished with value: 0.2624463030723319 and parameters: {'alpha': 0.05434858983548501, 'beta': 0.14760487662820396}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:47,816] Trial 19 finished with value: 0.2534241117376801 and parameters: {'alpha': 1.6676312952549865, 'beta': 0.8196291019647991}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:50,086] Trial 20 finished with value: 0.6136681773244484 and parameters: {'alpha': 0.018402498679560293, 'beta': 2.7627154655755097}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:49:54,285] Trial 21 finished with value: 0.5763635402234646 and parameters: {'alpha': 0.025277442814963108, 'beta': 2.2182818159540836}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:01,261] Trial 22 finished with value: 0.28160215548388884 and parameters: {'alpha': 0.028312142991574696, 'beta': 0.13216047577954873}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:06,871] Trial 23 finished with value: 0.2670443579935895 and parameters: {'alpha': 0.052482047195546604, 'beta': 0.22096420743638545}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:11,486] Trial 24 finished with value: 0.6122493909217629 and parameters: {'alpha': 0.0010083202897365696, 'beta': 0.10289205869423411}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:16,122] Trial 25 finished with value: 0.42536206095847234 and parameters: {'alpha': 0.006300541896042961, 'beta': 0.13757318916953165}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:18,308] Trial 26 finished with value: 0.25370515925329545 and parameters: {'alpha': 17.14314059944798, 'beta': 0.5445674288374801}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:24,430] Trial 27 finished with value: 0.4537226609689404 and parameters: {'alpha': 0.005182524478730239, 'beta': 0.1474118096304856}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:25,257] Trial 28 finished with value: 0.6708282523854553 and parameters: {'alpha': 0.005316583849282889, 'beta': 4.0367212039236}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:32,716] Trial 29 finished with value: 0.6608943297272081 and parameters: {'alpha': 0.001979588001520533, 'beta': 0.9554860591852641}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:34,978] Trial 30 finished with value: 0.2533295189669541 and parameters: {'alpha': 0.9239268209588617, 'beta': 0.21977061463918507}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:42,389] Trial 31 finished with value: 0.6325206367483559 and parameters: {'alpha': 0.002156386814216444, 'beta': 0.6030710712800158}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:48,918] Trial 32 finished with value: 0.40139719697799936 and parameters: {'alpha': 0.008622741335225205, 'beta': 0.19107312623091394}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:50:58,061] Trial 33 finished with value: 0.5538114943905761 and parameters: {'alpha': 0.0024339928647812772, 'beta': 0.18503427955324564}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:02,591] Trial 34 finished with value: 0.25348003971297484 and parameters: {'alpha': 0.40456700937942475, 'beta': 0.1048090567134247}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:04,487] Trial 35 finished with value: 0.25334001038515064 and parameters: {'alpha': 1.6817559574210674, 'beta': 0.15952270389288467}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:05,981] Trial 36 finished with value: 0.25357008946026316 and parameters: {'alpha': 2.751866880709681, 'beta': 1.9955346519488806}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:09,955] Trial 37 finished with value: 0.2540227497627727 and parameters: {'alpha': 0.19040655692710728, 'beta': 0.15766429159037143}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:11,452] Trial 38 finished with value: 0.25346977940721255 and parameters: {'alpha': 6.0547754501734286, 'beta': 0.32898243110550485}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:12,457] Trial 39 finished with value: 0.2533731197904963 and parameters: {'alpha': 4.538369331666435, 'beta': 0.35721735216796696}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:13,846] Trial 40 finished with value: 0.25488191726116166 and parameters: {'alpha': 8.41625862318416, 'beta': 0.14782279441522467}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:14,542] Trial 41 finished with value: 0.6830503140794308 and parameters: {'alpha': 0.002238394848611824, 'beta': 3.376971957340652}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:15,659] Trial 42 finished with value: 0.2611298045230915 and parameters: {'alpha': 10.193321138257975, 'beta': 3.8622364737184953}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:18,241] Trial 43 finished with value: 0.25639108671877314 and parameters: {'alpha': 0.9414220587113913, 'beta': 1.5923011876519109}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:20,649] Trial 44 finished with value: 0.2536525974842951 and parameters: {'alpha': 5.752454420636471, 'beta': 0.23750570096682547}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:27,949] Trial 45 finished with value: 0.4475752173325199 and parameters: {'alpha': 0.005613259031264765, 'beta': 0.16106038188555916}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:29,734] Trial 46 finished with value: 0.378963255953341 and parameters: {'alpha': 0.16298409712534045, 'beta': 3.092552609277608}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:36,820] Trial 47 finished with value: 0.5022525188591187 and parameters: {'alpha': 0.005788956835694668, 'beta': 0.3645869560577458}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:40,119] Trial 48 finished with value: 0.2584473611810399 and parameters: {'alpha': 0.7046014884714875, 'beta': 1.5156285838538937}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:41,300] Trial 49 finished with value: 0.2796366129684313 and parameters: {'alpha': 0.5709027901752046, 'beta': 3.9960227879792063}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:44,860] Trial 50 finished with value: 0.2807710187430597 and parameters: {'alpha': 0.40975533296277133, 'beta': 2.1401748163930003}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:51:51,104] Trial 51 finished with value: 0.6057217868842064 and parameters: {'alpha': 0.008584599040023599, 'beta': 1.218163655165405}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:00,577] Trial 52 finished with value: 0.2745217081871301 and parameters: {'alpha': 0.24277731586758988, 'beta': 1.2251218157784955}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:07,339] Trial 53 finished with value: 0.3458611172282059 and parameters: {'alpha': 0.167449793102504, 'beta': 2.077395763142298}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:14,084] Trial 54 finished with value: 0.2643744249026928 and parameters: {'alpha': 15.697525702377513, 'beta': 0.1499925019031478}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:20,291] Trial 55 finished with value: 0.588690649972716 and parameters: {'alpha': 0.003398852037349372, 'beta': 0.5078616974420543}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:23,739] Trial 56 finished with value: 0.25356314341828573 and parameters: {'alpha': 0.40990189523267573, 'beta': 0.1605541265707268}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:25,393] Trial 57 finished with value: 0.2532156320105167 and parameters: {'alpha': 8.176291170059795, 'beta': 0.6028889508899746}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:26,219] Trial 58 finished with value: 0.6762504398223311 and parameters: {'alpha': 0.0038491089860435345, 'beta': 3.5728218032008567}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:27,789] Trial 59 finished with value: 0.36361405798652174 and parameters: {'alpha': 18.883077165135866, 'beta': 3.900360140078018}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:28,305] Trial 60 finished with value: 0.6866258986576682 and parameters: {'alpha': 0.0015432396297236654, 'beta': 4.496855465972027}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:28,950] Trial 61 finished with value: 0.6839754386852761 and parameters: {'alpha': 0.00216144761046407, 'beta': 4.267996718851435}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:30,048] Trial 62 finished with value: 0.25342990716884695 and parameters: {'alpha': 1.6514494161266575, 'beta': 0.8162021710111697}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:35,243] Trial 63 finished with value: 0.46475755531418966 and parameters: {'alpha': 0.03546962917334779, 'beta': 1.2773693142951903}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:40,556] Trial 64 finished with value: 0.35503818939208326 and parameters: {'alpha': 19.923282303754874, 'beta': 0.1705692933078928}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:48,698] Trial 65 finished with value: 0.4127642720535385 and parameters: {'alpha': 0.07385456381290537, 'beta': 1.6403120079453284}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:55,966] Trial 66 finished with value: 0.553871831877108 and parameters: {'alpha': 0.02262240796144007, 'beta': 1.6083530648707909}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:52:56,730] Trial 67 finished with value: 0.6840347766093524 and parameters: {'alpha': 0.0020509698428309384, 'beta': 3.5717378566355356}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:04,511] Trial 68 finished with value: 0.6599811448245204 and parameters: {'alpha': 0.0011596706042925776, 'beta': 0.6241470450296943}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:11,196] Trial 69 finished with value: 0.2601742084450298 and parameters: {'alpha': 0.34282445200892325, 'beta': 1.0399229508259498}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:14,230] Trial 70 finished with value: 0.6760544217371368 and parameters: {'alpha': 0.002350830050384596, 'beta': 1.698165358208643}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:20,380] Trial 71 finished with value: 0.29813457245745834 and parameters: {'alpha': 0.024103382865438797, 'beta': 0.18899340154250233}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:21,814] Trial 72 finished with value: 0.25347817560006236 and parameters: {'alpha': 0.9749751428615613, 'beta': 0.46957144309474796}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:23,192] Trial 73 finished with value: 0.6029579819205977 and parameters: {'alpha': 0.023163717716474335, 'beta': 3.2774424810394236}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:24,044] Trial 74 finished with value: 0.25339275480018975 and parameters: {'alpha': 3.961495236002598, 'beta': 0.3553406360895096}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:28,948] Trial 75 finished with value: 0.2543410820394738 and parameters: {'alpha': 0.15773116412703936, 'beta': 0.19985754222709737}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:31,691] Trial 76 finished with value: 0.25951232229523097 and parameters: {'alpha': 0.6430124937801786, 'beta': 1.5257966616606295}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:33,459] Trial 77 finished with value: 0.2531330233853231 and parameters: {'alpha': 17.15215290924629, 'beta': 0.8281962360140841}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:38,701] Trial 78 finished with value: 0.3499069915898615 and parameters: {'alpha': 0.03433444241219424, 'beta': 0.6351630257120043}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:45,146] Trial 79 finished with value: 0.5015940871374382 and parameters: {'alpha': 0.006335010278670611, 'beta': 0.4037488745525979}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:53,060] Trial 80 finished with value: 0.40533275393656903 and parameters: {'alpha': 0.006963921342434452, 'beta': 0.11414566273066946}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:53:59,240] Trial 81 finished with value: 0.2548058484759766 and parameters: {'alpha': 0.10530878414733691, 'beta': 0.10672799346055516}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:07,978] Trial 82 finished with value: 0.26400937336525343 and parameters: {'alpha': 0.12534139006646522, 'beta': 0.5667687358341221}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:08,907] Trial 83 finished with value: 0.25334240998422924 and parameters: {'alpha': 1.9350918063335578, 'beta': 0.6627799232584476}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:10,682] Trial 84 finished with value: 0.2545947330774495 and parameters: {'alpha': 8.088880205905335, 'beta': 0.1800792688653425}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:17,184] Trial 85 finished with value: 0.257631993832168 and parameters: {'alpha': 0.13900025395392251, 'beta': 0.41144414741427904}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:24,102] Trial 86 finished with value: 0.5699325854886954 and parameters: {'alpha': 0.004886852686272949, 'beta': 0.5841745247991483}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:31,055] Trial 87 finished with value: 0.2605762324094238 and parameters: {'alpha': 0.07262308625376379, 'beta': 0.2244222476150922}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:32,374] Trial 88 finished with value: 0.390010208161573 and parameters: {'alpha': 0.15833335319279582, 'beta': 3.6446565674593163}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:34,714] Trial 89 finished with value: 0.2535644464749867 and parameters: {'alpha': 14.901665421205784, 'beta': 0.5371308703674542}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:40,516] Trial 90 finished with value: 0.37205171058491837 and parameters: {'alpha': 16.434652676910783, 'beta': 0.12276411861764346}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:44,549] Trial 91 finished with value: 0.25372848369155554 and parameters: {'alpha': 0.23375892862562156, 'beta': 0.10294820633779465}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:45,659] Trial 92 finished with value: 0.2534100816397824 and parameters: {'alpha': 2.8570830261267517, 'beta': 0.171386508188979}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:46,863] Trial 93 finished with value: 0.2562547189419146 and parameters: {'alpha': 1.69272083363081, 'beta': 4.262963326661442}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:49,103] Trial 94 finished with value: 0.57573004765703 and parameters: {'alpha': 0.030620021235152745, 'beta': 2.9357568834727363}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:54:54,764] Trial 95 finished with value: 0.2644420986654344 and parameters: {'alpha': 0.046511778641180924, 'beta': 0.12358847431304315}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:04,502] Trial 96 finished with value: 0.4570697102239783 and parameters: {'alpha': 0.012417083074747936, 'beta': 0.5585586489875635}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:10,340] Trial 97 finished with value: 0.4306924484192744 and parameters: {'alpha': 0.01998248055410391, 'beta': 0.7023008370251644}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:11,227] Trial 98 finished with value: 0.2533071138280588 and parameters: {'alpha': 2.019377414207188, 'beta': 0.33000477109635423}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:12,516] Trial 99 finished with value: 0.2556934256356709 and parameters: {'alpha': 13.43208722425335, 'beta': 0.3357574075951252}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:13,466] Trial 100 finished with value: 0.2533138839741712 and parameters: {'alpha': 2.4065769304544857, 'beta': 0.2945207424130173}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:14,368] Trial 101 finished with value: 0.25331459792708566 and parameters: {'alpha': 2.251127344981853, 'beta': 0.27824856897134226}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:15,293] Trial 102 finished with value: 0.25331967140664796 and parameters: {'alpha': 2.3490259016448247, 'beta': 0.2693468560455671}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:16,170] Trial 103 finished with value: 0.25333024951619143 and parameters: {'alpha': 2.5982209540023593, 'beta': 0.2712062787045259}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:17,134] Trial 104 finished with value: 0.2532120886441386 and parameters: {'alpha': 3.745056000015615, 'beta': 0.8218468514562575}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:19,823] Trial 105 finished with value: 0.25321233997185044 and parameters: {'alpha': 5.433033000561476, 'beta': 0.8305952534014956}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:23,308] Trial 106 finished with value: 0.253215609944921 and parameters: {'alpha': 3.5985063116529585, 'beta': 0.8136081436891558}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:25,299] Trial 107 finished with value: 0.2532130846137799 and parameters: {'alpha': 3.6575733955727254, 'beta': 0.8278918292682286}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:27,366] Trial 108 finished with value: 0.25321610438384595 and parameters: {'alpha': 3.6115918581410438, 'beta': 0.8058703744034776}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:29,217] Trial 109 finished with value: 0.25321547403467315 and parameters: {'alpha': 3.5051231599184307, 'beta': 0.8455020834521583}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:31,230] Trial 110 finished with value: 0.25321207695783665 and parameters: {'alpha': 3.592680446916541, 'beta': 0.8611929150336922}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:33,036] Trial 111 finished with value: 0.25320868686509684 and parameters: {'alpha': 3.652277405248507, 'beta': 0.8915909359954296}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:34,821] Trial 112 finished with value: 0.25321601244530556 and parameters: {'alpha': 3.446170366919537, 'beta': 0.8753174508069022}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:36,601] Trial 113 finished with value: 0.25320213669276753 and parameters: {'alpha': 5.340148825953277, 'beta': 0.8625195034705243}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:39,089] Trial 114 finished with value: 0.25317575868268294 and parameters: {'alpha': 5.79146271257282, 'beta': 0.7467883225835172}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:40,709] Trial 115 finished with value: 0.25317375571710854 and parameters: {'alpha': 5.673995590306331, 'beta': 0.7475566342217709}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:43,320] Trial 116 finished with value: 0.25317091835189515 and parameters: {'alpha': 5.600350415350862, 'beta': 0.7527434108660279}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:45,307] Trial 117 finished with value: 0.25317271127308594 and parameters: {'alpha': 5.444733841776656, 'beta': 0.7420158053509285}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:47,108] Trial 118 finished with value: 0.2531723838940286 and parameters: {'alpha': 5.595051801496928, 'beta': 0.7484045609805913}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:49,556] Trial 119 finished with value: 0.2532021943389545 and parameters: {'alpha': 10.494751869770038, 'beta': 0.7163618211823322}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:51,568] Trial 120 finished with value: 0.2531211616361721 and parameters: {'alpha': 10.957437234793199, 'beta': 0.7375587937212197}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:53,704] Trial 121 finished with value: 0.253145442225312 and parameters: {'alpha': 11.933010072874389, 'beta': 0.7449646126111089}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:56,592] Trial 122 finished with value: 0.25313859889581813 and parameters: {'alpha': 11.856709760615981, 'beta': 0.7486274219397674}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:55:59,094] Trial 123 finished with value: 0.25314762331207896 and parameters: {'alpha': 11.016667549676624, 'beta': 0.7151089249243056}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:56:00,970] Trial 124 finished with value: 0.25319671191710497 and parameters: {'alpha': 6.742914221355471, 'beta': 0.743074971395113}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:56:03,220] Trial 125 finished with value: 0.25320158668732345 and parameters: {'alpha': 6.6528740260236034, 'beta': 0.7299048213291167}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:56:05,134] Trial 126 finished with value: 0.2531119814203936 and parameters: {'alpha': 11.764137240113016, 'beta': 1.0168195208960398}. Best is trial 11 with value: 0.2530997272200076.
[I 2022-11-24 18:56:06,741] Trial 127 finished with value: 0.2530978987826827 and parameters: {'alpha': 11.290573903941825, 'beta': 1.0498631198105768}. Best is trial 127 with value: 0.2530978987826827.
[I 2022-11-24 18:56:09,427] Trial 128 finished with value: 0.25310857424424293 and parameters: {'alpha': 11.523074514030819, 'beta': 1.0199941691123942}. Best is trial 127 with value: 0.2530978987826827.
[I 2022-11-24 18:56:11,419] Trial 129 finished with value: 0.25311915916195676 and parameters: {'alpha': 9.620219384060565, 'beta': 1.0611437947691864}. Best is trial 127 with value: 0.2530978987826827.
[I 2022-11-24 18:56:14,083] Trial 130 finished with value: 0.25309325080851297 and parameters: {'alpha': 11.642678028367618, 'beta': 1.102585515528071}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:15,195] Trial 131 finished with value: 0.2531002881480465 and parameters: {'alpha': 11.724888769488784, 'beta': 1.0606070856407845}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:16,624] Trial 132 finished with value: 0.2530964828946584 and parameters: {'alpha': 12.165796256184166, 'beta': 1.0837554171017592}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:18,787] Trial 133 finished with value: 0.2531256436073116 and parameters: {'alpha': 12.390539170246065, 'beta': 1.3517725536152234}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:20,180] Trial 134 finished with value: 0.2530949207804414 and parameters: {'alpha': 11.918069132655047, 'beta': 1.0952951256502965}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:21,611] Trial 135 finished with value: 0.25309330619054016 and parameters: {'alpha': 12.658798916833742, 'beta': 1.0847482567021631}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:22,849] Trial 136 finished with value: 0.25309350846823536 and parameters: {'alpha': 8.944755974804727, 'beta': 1.0927450186388048}. Best is trial 130 with value: 0.25309325080851297.
[I 2022-11-24 18:56:23,961] Trial 137 finished with value: 0.25308517950449494 and parameters: {'alpha': 8.273492462476792, 'beta': 1.0977192490083716}. Best is trial 137 with value: 0.25308517950449494.
[I 2022-11-24 18:56:25,635] Trial 138 finished with value: 0.2531186931842739 and parameters: {'alpha': 8.756483909125354, 'beta': 1.3656895930168234}. Best is trial 137 with value: 0.25308517950449494.
[I 2022-11-24 18:56:27,232] Trial 139 finished with value: 0.253094700058188 and parameters: {'alpha': 8.953185229776974, 'beta': 1.0884820865291964}. Best is trial 137 with value: 0.25308517950449494.
[I 2022-11-24 18:56:28,634] Trial 140 finished with value: 0.2530846425598874 and parameters: {'alpha': 8.293671861383618, 'beta': 1.1006894032474723}. Best is trial 140 with value: 0.2530846425598874.
[I 2022-11-24 18:56:30,417] Trial 141 finished with value: 0.2530873306066036 and parameters: {'alpha': 8.762070780205942, 'beta': 1.1073822152187325}. Best is trial 140 with value: 0.2530846425598874.
[I 2022-11-24 18:56:31,698] Trial 142 finished with value: 0.2530838492990909 and parameters: {'alpha': 8.278377982413936, 'beta': 1.104243887857621}. Best is trial 142 with value: 0.2530838492990909.
[I 2022-11-24 18:56:33,423] Trial 143 finished with value: 0.2530796232713341 and parameters: {'alpha': 7.94261458856502, 'beta': 1.1268143220794664}. Best is trial 143 with value: 0.2530796232713341.
[I 2022-11-24 18:56:34,502] Trial 144 finished with value: 0.25314429902848884 and parameters: {'alpha': 7.619252288626003, 'beta': 1.1362181267723108}. Best is trial 143 with value: 0.2530796232713341.
[I 2022-11-24 18:56:35,990] Trial 145 finished with value: 0.25302671768121143 and parameters: {'alpha': 14.088701822986295, 'beta': 1.1234686468526847}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:37,822] Trial 146 finished with value: 0.2530792906749046 and parameters: {'alpha': 8.655728703077894, 'beta': 1.1410607895131453}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:38,824] Trial 147 finished with value: 0.25313964581506926 and parameters: {'alpha': 7.733397868702159, 'beta': 1.1588485957550734}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:41,737] Trial 148 finished with value: 0.25309320202129126 and parameters: {'alpha': 15.21011932363201, 'beta': 1.3469281232873425}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:44,780] Trial 149 finished with value: 0.2531194458036001 and parameters: {'alpha': 14.771504683509686, 'beta': 1.402305824396675}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:47,374] Trial 150 finished with value: 0.2530291653519117 and parameters: {'alpha': 19.925640184349113, 'beta': 1.1357365321638597}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:49,958] Trial 151 finished with value: 0.25302820834604706 and parameters: {'alpha': 19.828550178858258, 'beta': 1.1481643598600815}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:51,830] Trial 152 finished with value: 0.2530656845790555 and parameters: {'alpha': 16.89478723362766, 'beta': 1.1944885945426904}. Best is trial 145 with value: 0.25302671768121143.
[I 2022-11-24 18:56:55,093] Trial 153 finished with value: 0.2530251290092929 and parameters: {'alpha': 18.4080395202224, 'beta': 0.9427216903779865}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:56:56,927] Trial 154 finished with value: 0.253044485456398 and parameters: {'alpha': 19.4520451463372, 'beta': 1.2303532772370762}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:56:59,252] Trial 155 finished with value: 0.253058930896575 and parameters: {'alpha': 19.851611156296954, 'beta': 1.2475338026620628}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:03,867] Trial 156 finished with value: 0.25503321472415036 and parameters: {'alpha': 19.75946065188387, 'beta': 1.819895411171875}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:05,602] Trial 157 finished with value: 0.2530811849655894 and parameters: {'alpha': 17.26396873915976, 'beta': 1.2284850322866345}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:09,037] Trial 158 finished with value: 0.2530710937880275 and parameters: {'alpha': 16.58078865541627, 'beta': 1.2452446570757443}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:11,671] Trial 159 finished with value: 0.2530625241492104 and parameters: {'alpha': 16.35806973304301, 'beta': 1.2312432462081504}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:14,851] Trial 160 finished with value: 0.25310557819243745 and parameters: {'alpha': 17.890582777553895, 'beta': 1.2483444885120492}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:17,445] Trial 161 finished with value: 0.2530428928646078 and parameters: {'alpha': 15.840197535124835, 'beta': 0.9530273866261516}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:19,618] Trial 162 finished with value: 0.25305116603681066 and parameters: {'alpha': 19.857536376729634, 'beta': 0.9457324735704487}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:22,195] Trial 163 finished with value: 0.2532796488115409 and parameters: {'alpha': 19.04855878608614, 'beta': 1.4649566094167574}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:24,364] Trial 164 finished with value: 0.25304266437631867 and parameters: {'alpha': 15.725481199910677, 'beta': 0.9531584783323749}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:29,228] Trial 165 finished with value: 0.25303271262771165 and parameters: {'alpha': 15.733852024874684, 'beta': 0.9689724299791737}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:33,015] Trial 166 finished with value: 0.25304650844395493 and parameters: {'alpha': 16.182473801987125, 'beta': 0.9551951131485436}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:37,231] Trial 167 finished with value: 0.25305852090660774 and parameters: {'alpha': 16.126481430163523, 'beta': 1.233717892136036}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:40,042] Trial 168 finished with value: 0.2531081433455143 and parameters: {'alpha': 14.83113678406405, 'beta': 0.9495629787936865}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:42,056] Trial 169 finished with value: 0.2530403582995877 and parameters: {'alpha': 19.80848653081675, 'beta': 0.9552033237289167}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:43,839] Trial 170 finished with value: 0.2530505326320353 and parameters: {'alpha': 19.20449472582276, 'beta': 1.2489351528631218}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:45,971] Trial 171 finished with value: 0.25305186421736875 and parameters: {'alpha': 15.504966724631489, 'beta': 0.9346516081687043}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:48,078] Trial 172 finished with value: 0.25306067088421413 and parameters: {'alpha': 19.294048498973233, 'beta': 0.9262289179004625}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:51,973] Trial 173 finished with value: 0.253035551312453 and parameters: {'alpha': 19.760223542204006, 'beta': 0.9591965493757714}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:54,317] Trial 174 finished with value: 0.2530340951159224 and parameters: {'alpha': 19.708393050188494, 'beta': 0.9597298238462248}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:55,968] Trial 175 finished with value: 0.253042822268913 and parameters: {'alpha': 19.190684683763127, 'beta': 0.9406078662207676}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:57,610] Trial 176 finished with value: 0.253121066416451 and parameters: {'alpha': 19.470253822046743, 'beta': 0.8852124371205351}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:57:58,864] Trial 177 finished with value: 0.2530948064129403 and parameters: {'alpha': 14.53986719302355, 'beta': 0.9600020118964089}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:00,147] Trial 178 finished with value: 0.2530840716777331 and parameters: {'alpha': 14.34778917619622, 'beta': 0.9719445962914494}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:03,210] Trial 179 finished with value: 0.2530629593337822 and parameters: {'alpha': 19.739251253096672, 'beta': 0.9329974231643618}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:06,242] Trial 180 finished with value: 0.2530602998396844 and parameters: {'alpha': 14.081321627375528, 'beta': 1.0040492753230172}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:09,252] Trial 181 finished with value: 0.25309532532434376 and parameters: {'alpha': 14.301241685475764, 'beta': 0.9522444171373217}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:11,457] Trial 182 finished with value: 0.25307878954527985 and parameters: {'alpha': 14.943986601269527, 'beta': 1.000089185731661}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:15,710] Trial 183 finished with value: 0.2530900105757961 and parameters: {'alpha': 19.258464960745833, 'beta': 1.2995510190834543}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:22,223] Trial 184 finished with value: 0.2530863902075561 and parameters: {'alpha': 14.444329201763297, 'beta': 0.9707795229567732}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:29,859] Trial 185 finished with value: 0.25308562548940555 and parameters: {'alpha': 19.533062261454848, 'beta': 0.9108569553041096}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:34,214] Trial 186 finished with value: 0.2532143220625553 and parameters: {'alpha': 15.697045395499583, 'beta': 1.4635110367269635}. Best is trial 153 with value: 0.2530251290092929.
[I 2022-11-24 18:58:39,005] Trial 187 finished with value: 0.2529979041050256 and parameters: {'alpha': 19.906127568487854, 'beta': 1.0095154011157796}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:43,267] Trial 188 finished with value: 0.2530773368298845 and parameters: {'alpha': 16.197791852039668, 'beta': 0.9176527686540702}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:47,715] Trial 189 finished with value: 0.2530360027439261 and parameters: {'alpha': 19.48629304812178, 'beta': 1.2087405316145672}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:50,934] Trial 190 finished with value: 0.2530470742977426 and parameters: {'alpha': 13.283903301312309, 'beta': 1.000024789416032}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:52,862] Trial 191 finished with value: 0.25304882163904097 and parameters: {'alpha': 13.456029567172623, 'beta': 1.0019651255309463}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:55,275] Trial 192 finished with value: 0.2530516959533183 and parameters: {'alpha': 13.316426727366451, 'beta': 0.9903877909265183}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:56,843] Trial 193 finished with value: 0.25304035879480746 and parameters: {'alpha': 13.023264222337948, 'beta': 1.012225965254856}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:58:59,217] Trial 194 finished with value: 0.253041798417935 and parameters: {'alpha': 13.292776231408807, 'beta': 1.013396875479028}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:59:00,918] Trial 195 finished with value: 0.2530742695940766 and parameters: {'alpha': 10.184772353743618, 'beta': 1.0308185989532215}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:59:02,920] Trial 196 finished with value: 0.2531060069129414 and parameters: {'alpha': 12.02498740217464, 'beta': 0.8733791529309964}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:59:05,041] Trial 197 finished with value: 0.25307979082191295 and parameters: {'alpha': 13.39296699044587, 'beta': 1.170751366956416}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:59:07,450] Trial 198 finished with value: 0.25301207166937095 and parameters: {'alpha': 16.57580697978345, 'beta': 1.0273116044894441}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:59:09,482] Trial 199 finished with value: 0.25310618183426603 and parameters: {'alpha': 10.163692749945847, 'beta': 0.807011163156476}. Best is trial 187 with value: 0.2529979041050256.
[I 2022-11-24 18:59:12,304] A new study created in memory with name: no-name-a0aa11bc-0822-49cb-bdd7-181cdd38690f
[I 2022-11-24 18:59:14,333] Trial 0 finished with value: 0.45918337017669925 and parameters: {'alpha': 0.07998009242454802, 'beta': 0.104406653291238}. Best is trial 0 with value: 0.45918337017669925.
[I 2022-11-24 18:59:16,157] Trial 1 finished with value: 0.6605063084172319 and parameters: {'alpha': 0.03212848823414773, 'beta': 0.8818478339721809}. Best is trial 0 with value: 0.45918337017669925.
[I 2022-11-24 18:59:16,761] Trial 2 finished with value: 0.6081959425976355 and parameters: {'alpha': 0.3901080136522924, 'beta': 4.25594057633195}. Best is trial 0 with value: 0.45918337017669925.
[I 2022-11-24 18:59:19,521] Trial 3 finished with value: 0.2569560641501776 and parameters: {'alpha': 13.571917010260744, 'beta': 0.5463598638151052}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:21,193] Trial 4 finished with value: 0.5303073287297585 and parameters: {'alpha': 0.05636282182385553, 'beta': 0.20146418534041263}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:22,978] Trial 5 finished with value: 0.4168192968122628 and parameters: {'alpha': 0.3444666138524802, 'beta': 0.6304698208965239}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:25,069] Trial 6 finished with value: 0.35367864867678717 and parameters: {'alpha': 0.2042113750141899, 'beta': 0.1438490666855973}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:26,733] Trial 7 finished with value: 0.38215844880455313 and parameters: {'alpha': 0.35528378857090187, 'beta': 0.5059088506111606}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:28,175] Trial 8 finished with value: 0.6807753346481097 and parameters: {'alpha': 0.01656233705822355, 'beta': 1.099909565610099}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:29,844] Trial 9 finished with value: 0.45517265547363733 and parameters: {'alpha': 0.8009149465211269, 'beta': 1.4988734711291998}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:32,367] Trial 10 finished with value: 0.4374375388273579 and parameters: {'alpha': 0.7044250163302468, 'beta': 1.219760568219689}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:34,299] Trial 11 finished with value: 0.6748223798075272 and parameters: {'alpha': 0.005279321959944999, 'beta': 0.2659997511027679}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:37,016] Trial 12 finished with value: 0.30976419316525294 and parameters: {'alpha': 0.6839477241358692, 'beta': 0.48330272333640534}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:38,563] Trial 13 finished with value: 0.682125219122819 and parameters: {'alpha': 0.008820703611436444, 'beta': 0.7814465933681364}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:40,552] Trial 14 finished with value: 0.6404675275675787 and parameters: {'alpha': 0.031946178358526305, 'beta': 0.5851315311651341}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:42,239] Trial 15 finished with value: 0.6848554602608922 and parameters: {'alpha': 0.002712860077358832, 'beta': 0.33117207077575794}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:42,507] Trial 16 finished with value: 0.689572120479892 and parameters: {'alpha': 0.011425314345509788, 'beta': 2.177676909108289}. Best is trial 3 with value: 0.2569560641501776.
[I 2022-11-24 18:59:44,340] Trial 17 finished with value: 0.25470671562069297 and parameters: {'alpha': 3.65314587204581, 'beta': 0.3762456660998206}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:46,697] Trial 18 finished with value: 0.30323614369348073 and parameters: {'alpha': 2.6393583580043942, 'beta': 1.5028965914522863}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:48,981] Trial 19 finished with value: 0.6689421177535405 and parameters: {'alpha': 0.005819671335741711, 'beta': 0.18283721929210645}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:51,277] Trial 20 finished with value: 0.25949326576250437 and parameters: {'alpha': 2.2344735245114142, 'beta': 0.47134557082453893}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:51,493] Trial 21 finished with value: 0.6789918529114668 and parameters: {'alpha': 0.05457729207623495, 'beta': 3.1200292642984273}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:52,255] Trial 22 finished with value: 0.6897874891353376 and parameters: {'alpha': 0.0033015633709386014, 'beta': 0.7442734294115254}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:54,287] Trial 23 finished with value: 0.6535534006264211 and parameters: {'alpha': 0.09667465483919158, 'beta': 1.6700633679753807}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:56,800] Trial 24 finished with value: 0.26393306603046607 and parameters: {'alpha': 1.739746684226588, 'beta': 0.4687325581508196}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:57,555] Trial 25 finished with value: 0.6911549645472816 and parameters: {'alpha': 0.0012003520589100845, 'beta': 0.38113531484688407}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:58,568] Trial 26 finished with value: 0.2639177704355682 and parameters: {'alpha': 5.745232951296163, 'beta': 1.7622545801702303}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:59,490] Trial 27 finished with value: 0.585652832044592 and parameters: {'alpha': 0.45497361098649225, 'beta': 2.8961438339282073}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:59,683] Trial 28 finished with value: 0.6919131697416425 and parameters: {'alpha': 0.004751658805345281, 'beta': 3.0919633534613014}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 18:59:59,841] Trial 29 finished with value: 0.6917543438864615 and parameters: {'alpha': 0.005058841851244498, 'beta': 2.6117142612423287}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:02,145] Trial 30 finished with value: 0.5066746626464214 and parameters: {'alpha': 15.985992951359666, 'beta': 2.2595850962834088}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:04,023] Trial 31 finished with value: 0.7428289835121226 and parameters: {'alpha': 15.083751432876095, 'beta': 3.5045608014985468}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:04,540] Trial 32 finished with value: 0.5231616061143701 and parameters: {'alpha': 0.9086057551028361, 'beta': 4.939736778142253}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:04,664] Trial 33 finished with value: 0.6925852598515871 and parameters: {'alpha': 0.0021747219793728225, 'beta': 2.7955122520622684}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:06,507] Trial 34 finished with value: 0.5836220373003334 and parameters: {'alpha': 0.03782482710211143, 'beta': 0.25965336899943026}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:07,912] Trial 35 finished with value: 0.6547919182221238 and parameters: {'alpha': 0.015231008943132958, 'beta': 0.3930142627311112}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:09,320] Trial 36 finished with value: 0.6746838241885321 and parameters: {'alpha': 0.004245030948961805, 'beta': 0.16858056367987062}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:10,816] Trial 37 finished with value: 0.6150569523493827 and parameters: {'alpha': 0.07079919003390688, 'beta': 0.7752617131589815}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:10,984] Trial 38 finished with value: 0.6928376888442492 and parameters: {'alpha': 0.0012915522098315955, 'beta': 4.043779460269908}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:11,248] Trial 39 finished with value: 0.36545562126690545 and parameters: {'alpha': 3.5858311557039957, 'beta': 4.736430251923028}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:11,440] Trial 40 finished with value: 0.6919534340279158 and parameters: {'alpha': 0.003267276010107063, 'beta': 1.5854107594457771}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:12,898] Trial 41 finished with value: 0.66974727301525 and parameters: {'alpha': 0.035054549005751764, 'beta': 1.1965092240058353}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:13,329] Trial 42 finished with value: 0.6909998367825892 and parameters: {'alpha': 0.0037807244622732462, 'beta': 1.0944578980223412}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:14,674] Trial 43 finished with value: 0.6863691921764074 and parameters: {'alpha': 0.0034337007343509867, 'beta': 0.5397626111679125}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:16,096] Trial 44 finished with value: 0.5347699422319776 and parameters: {'alpha': 0.40365472377372036, 'beta': 1.4294861966060886}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:17,584] Trial 45 finished with value: 0.5901527085864026 and parameters: {'alpha': 0.035052335208126284, 'beta': 0.26001193422015795}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:19,059] Trial 46 finished with value: 0.6807113490355824 and parameters: {'alpha': 0.0032609772414258346, 'beta': 0.2298665897106374}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:19,504] Trial 47 finished with value: 0.6908482964400674 and parameters: {'alpha': 0.004625939055984751, 'beta': 1.2297265650152727}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:19,774] Trial 48 finished with value: 0.6919483675828163 and parameters: {'alpha': 0.003180477209472519, 'beta': 1.5003380473372643}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:19,870] Trial 49 finished with value: 0.692507021384781 and parameters: {'alpha': 0.002726690974048925, 'beta': 4.662374922399737}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:21,320] Trial 50 finished with value: 0.5985726685204202 and parameters: {'alpha': 12.528003353246957, 'beta': 3.305864010007519}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:23,122] Trial 51 finished with value: 0.39445014375124454 and parameters: {'alpha': 0.5387644139236671, 'beta': 0.7859141200080553}. Best is trial 17 with value: 0.25470671562069297.
[I 2022-11-24 19:00:24,902] Trial 52 finished with value: 0.2544082153282544 and parameters: {'alpha': 2.5017933887588697, 'beta': 0.18752150336706683}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:25,193] Trial 53 finished with value: 0.3640930382935902 and parameters: {'alpha': 3.48248321956161, 'beta': 4.547240359779208}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:26,644] Trial 54 finished with value: 0.2850264410974672 and parameters: {'alpha': 0.4648477745740651, 'beta': 0.13573705743789888}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:28,002] Trial 55 finished with value: 0.42118605957137834 and parameters: {'alpha': 0.29941319743776523, 'beta': 0.5743548109081791}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:29,534] Trial 56 finished with value: 0.6846150180322373 and parameters: {'alpha': 0.0016364300064605933, 'beta': 0.10059730377972066}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:30,992] Trial 57 finished with value: 0.682925466292076 and parameters: {'alpha': 0.0037527965246345217, 'beta': 0.38212344039605467}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:31,630] Trial 58 finished with value: 0.6805007655228515 and parameters: {'alpha': 0.03798004005988245, 'beta': 2.0685195076239853}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:32,041] Trial 59 finished with value: 0.6888802185545116 and parameters: {'alpha': 0.01773219381850052, 'beta': 4.0962428391220085}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:34,123] Trial 60 finished with value: 0.6735637277998351 and parameters: {'alpha': 0.0081045796186667, 'beta': 0.4297015692162373}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:34,874] Trial 61 finished with value: 0.6623099114444722 and parameters: {'alpha': 0.13061827481594118, 'beta': 3.9863740255656617}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:37,418] Trial 62 finished with value: 0.6801661973077292 and parameters: {'alpha': 0.002702324681270798, 'beta': 0.13119175630502158}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:39,407] Trial 63 finished with value: 0.6866032132481401 and parameters: {'alpha': 0.001471642508517351, 'beta': 0.16883309690432005}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:41,642] Trial 64 finished with value: 0.5772807298054828 and parameters: {'alpha': 0.21270395324644698, 'beta': 1.207604347751331}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:42,037] Trial 65 finished with value: 0.6396487131241494 and parameters: {'alpha': 0.2062844717871088, 'beta': 2.822011849009167}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:43,325] Trial 66 finished with value: 0.6841778691457225 and parameters: {'alpha': 0.006146101479358393, 'beta': 0.6957645386773025}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:44,653] Trial 67 finished with value: 0.6636057122312432 and parameters: {'alpha': 0.006624210043962461, 'beta': 0.1488632056562406}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:44,963] Trial 68 finished with value: 0.3849151131778033 and parameters: {'alpha': 2.363658740843714, 'beta': 3.7268028093337873}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:45,276] Trial 69 finished with value: 0.6880966507218088 and parameters: {'alpha': 0.013834453129130068, 'beta': 1.8081038383698884}. Best is trial 52 with value: 0.2544082153282544.
[I 2022-11-24 19:00:45,966] Trial 70 finished with value: 0.25347154529138516 and parameters: {'alpha': 7.713387490391265, 'beta': 0.23986766711765856}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:46,587] Trial 71 finished with value: 0.25384993118517546 and parameters: {'alpha': 6.4804551708016085, 'beta': 0.40891630928556316}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:47,856] Trial 72 finished with value: 0.5259340366973367 and parameters: {'alpha': 0.5109213426427204, 'beta': 1.632808041282798}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:49,144] Trial 73 finished with value: 0.6770538571364461 and parameters: {'alpha': 0.007243410045087732, 'beta': 0.4729934644228669}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:50,437] Trial 74 finished with value: 0.2745988096651767 and parameters: {'alpha': 0.9812492917935645, 'beta': 0.36397786385445996}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:50,788] Trial 75 finished with value: 0.685477678694802 and parameters: {'alpha': 0.022407982680931464, 'beta': 1.9928231799498028}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:50,931] Trial 76 finished with value: 0.6924275091320795 and parameters: {'alpha': 0.0022300397597492835, 'beta': 1.789331057805383}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:52,221] Trial 77 finished with value: 0.30296728979472387 and parameters: {'alpha': 0.40350300438220293, 'beta': 0.19913060134753935}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:53,167] Trial 78 finished with value: 0.31787421693008067 and parameters: {'alpha': 2.8973120068660534, 'beta': 2.0337304386863497}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:54,539] Trial 79 finished with value: 0.33288669473899213 and parameters: {'alpha': 0.38609809853191335, 'beta': 0.3353118623668618}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:56,103] Trial 80 finished with value: 0.478538490255148 and parameters: {'alpha': 0.539568952379511, 'beta': 1.258051246745438}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:57,835] Trial 81 finished with value: 0.547992487421047 and parameters: {'alpha': 0.0406974821832407, 'beta': 0.1322591271413575}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:58,541] Trial 82 finished with value: 0.6761083158852974 and parameters: {'alpha': 0.06581584584303797, 'beta': 3.1060236560062062}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:00:58,709] Trial 83 finished with value: 0.6921647778838734 and parameters: {'alpha': 0.0032343937911465635, 'beta': 2.0533526282639425}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:01:00,395] Trial 84 finished with value: 0.5035715665438855 and parameters: {'alpha': 10.35127858878114, 'beta': 3.2676356457874314}. Best is trial 70 with value: 0.25347154529138516.
[I 2022-11-24 19:01:01,719] Trial 85 finished with value: 0.25339264769470926 and parameters: {'alpha': 12.29390768921097, 'beta': 0.26688102922910584}. Best is trial 85 with value: 0.25339264769470926.
[I 2022-11-24 19:01:02,997] Trial 86 finished with value: 0.2585241301260081 and parameters: {'alpha': 5.229026270764704, 'beta': 1.216779255450833}. Best is trial 85 with value: 0.25339264769470926.
[I 2022-11-24 19:01:04,774] Trial 87 finished with value: 0.6636812001842795 and parameters: {'alpha': 0.019164532562729663, 'beta': 0.6462695346418396}. Best is trial 85 with value: 0.25339264769470926.
[I 2022-11-24 19:01:06,582] Trial 88 finished with value: 0.6472381053871225 and parameters: {'alpha': 0.03175253405052751, 'beta': 0.6616233325097401}. Best is trial 85 with value: 0.25339264769470926.
[I 2022-11-24 19:01:06,923] Trial 89 finished with value: 0.6406267326217344 and parameters: {'alpha': 0.21402610091761592, 'beta': 3.2115449605193915}. Best is trial 85 with value: 0.25339264769470926.
[I 2022-11-24 19:01:08,511] Trial 90 finished with value: 0.35715074378540596 and parameters: {'alpha': 0.9215909926568934, 'beta': 0.9366534595107951}. Best is trial 85 with value: 0.25339264769470926.
[I 2022-11-24 19:01:10,038] Trial 91 finished with value: 0.2533376213218249 and parameters: {'alpha': 8.105495322265192, 'beta': 0.15059093111117577}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:11,445] Trial 92 finished with value: 0.31608745847668124 and parameters: {'alpha': 1.9435327155715478, 'beta': 1.25199566704948}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:13,098] Trial 93 finished with value: 0.2542275970134172 and parameters: {'alpha': 2.361600328236339, 'beta': 0.10851292541888284}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:13,653] Trial 94 finished with value: 0.6266446652951978 and parameters: {'alpha': 0.2349409675759827, 'beta': 2.3561670000498376}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:14,894] Trial 95 finished with value: 0.6788356235984687 and parameters: {'alpha': 0.025121652744944357, 'beta': 1.3080136054013765}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:16,252] Trial 96 finished with value: 0.4570118980127302 and parameters: {'alpha': 0.10849932761146708, 'beta': 0.22659162127709975}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:17,818] Trial 97 finished with value: 0.6294459661321593 and parameters: {'alpha': 0.032828393046687, 'beta': 0.4920483633799576}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:18,350] Trial 98 finished with value: 0.6924642798599449 and parameters: {'alpha': 0.0023981735437320446, 'beta': 2.3999535057646804}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:19,852] Trial 99 finished with value: 0.46905180091646653 and parameters: {'alpha': 0.08073149888066003, 'beta': 0.14020102888933295}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:20,692] Trial 100 finished with value: 0.2534159348700902 and parameters: {'alpha': 6.7036099031579175, 'beta': 0.11233808433588295}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:21,609] Trial 101 finished with value: 0.25371573832050587 and parameters: {'alpha': 6.311167697546939, 'beta': 0.3114646481794228}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:22,439] Trial 102 finished with value: 0.25336414772638005 and parameters: {'alpha': 6.960455983551887, 'beta': 0.11461175851892717}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:23,222] Trial 103 finished with value: 0.2533506441502092 and parameters: {'alpha': 7.9838558757233065, 'beta': 0.12019693301959238}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:23,956] Trial 104 finished with value: 0.2533428655747022 and parameters: {'alpha': 8.120130897897965, 'beta': 0.1095982692119183}. Best is trial 91 with value: 0.2533376213218249.
[I 2022-11-24 19:01:25,006] Trial 105 finished with value: 0.2533023881151956 and parameters: {'alpha': 8.476983908744282, 'beta': 0.1156617140283411}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:26,383] Trial 106 finished with value: 0.34532358361911636 and parameters: {'alpha': 19.85881905230965, 'beta': 0.11643057604874063}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:27,080] Trial 107 finished with value: 0.25335457980955683 and parameters: {'alpha': 8.175096229670268, 'beta': 0.11554892309893763}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:27,834] Trial 108 finished with value: 0.2533340108736208 and parameters: {'alpha': 7.66334815592181, 'beta': 0.11870330991015991}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:28,598] Trial 109 finished with value: 0.253317748012332 and parameters: {'alpha': 8.77350648993098, 'beta': 0.11799339819527765}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:29,352] Trial 110 finished with value: 0.25332127546658745 and parameters: {'alpha': 8.79451850898261, 'beta': 0.11958170123497734}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:30,219] Trial 111 finished with value: 0.2533086251575852 and parameters: {'alpha': 8.42503364422218, 'beta': 0.12149925274932105}. Best is trial 105 with value: 0.2533023881151956.
[I 2022-11-24 19:01:31,408] Trial 112 finished with value: 0.2532910544524379 and parameters: {'alpha': 9.486538562772587, 'beta': 0.11914415929807198}. Best is trial 112 with value: 0.2532910544524379.
[I 2022-11-24 19:01:32,264] Trial 113 finished with value: 0.2532950279513802 and parameters: {'alpha': 9.547621290903587, 'beta': 0.11956411853693984}. Best is trial 112 with value: 0.2532910544524379.
[I 2022-11-24 19:01:33,045] Trial 114 finished with value: 0.2532921367948591 and parameters: {'alpha': 9.461726237935638, 'beta': 0.1212927521815881}. Best is trial 112 with value: 0.2532910544524379.
[I 2022-11-24 19:01:33,849] Trial 115 finished with value: 0.2533230855575649 and parameters: {'alpha': 8.725958998145641, 'beta': 0.1226116398328125}. Best is trial 112 with value: 0.2532910544524379.
[I 2022-11-24 19:01:34,543] Trial 116 finished with value: 0.25380432177334517 and parameters: {'alpha': 4.785426324921592, 'beta': 0.15225972173787702}. Best is trial 112 with value: 0.2532910544524379.
[I 2022-11-24 19:01:35,349] Trial 117 finished with value: 0.253280289951694 and parameters: {'alpha': 9.048498313335493, 'beta': 0.12510417633663692}. Best is trial 117 with value: 0.253280289951694.
[I 2022-11-24 19:01:36,231] Trial 118 finished with value: 0.2533125655723817 and parameters: {'alpha': 9.733265315658649, 'beta': 0.12497842075828894}. Best is trial 117 with value: 0.253280289951694.
[I 2022-11-24 19:01:37,132] Trial 119 finished with value: 0.25327848564187727 and parameters: {'alpha': 10.361862943829209, 'beta': 0.1259787536713779}. Best is trial 119 with value: 0.25327848564187727.
[I 2022-11-24 19:01:37,880] Trial 120 finished with value: 0.2538614055564446 and parameters: {'alpha': 10.18365529259314, 'beta': 0.10058685669104303}. Best is trial 119 with value: 0.25327848564187727.
[I 2022-11-24 19:01:38,756] Trial 121 finished with value: 0.2532566276145242 and parameters: {'alpha': 10.120292626409094, 'beta': 0.12574078189445898}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:39,507] Trial 122 finished with value: 0.25377465771165314 and parameters: {'alpha': 4.349339498648967, 'beta': 0.12519428965472915}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:40,910] Trial 123 finished with value: 0.32676928530909805 and parameters: {'alpha': 17.49012700012715, 'beta': 0.16819366064736405}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:41,737] Trial 124 finished with value: 0.25332577708271464 and parameters: {'alpha': 9.90177164366879, 'beta': 0.12366678196801392}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:42,543] Trial 125 finished with value: 0.2533425290888543 and parameters: {'alpha': 10.626933444378276, 'beta': 0.12725048457437974}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:43,942] Trial 126 finished with value: 0.2655488326635743 and parameters: {'alpha': 12.64640944677932, 'beta': 0.13541054511243267}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:45,559] Trial 127 finished with value: 0.26562377750028926 and parameters: {'alpha': 14.065095716946088, 'beta': 0.16635287504424043}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:47,212] Trial 128 finished with value: 0.25331662301684643 and parameters: {'alpha': 10.221936263780021, 'beta': 0.15540507657115513}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:48,169] Trial 129 finished with value: 0.2539391085178535 and parameters: {'alpha': 3.9261572240109666, 'beta': 0.15545381424816057}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:49,951] Trial 130 finished with value: 0.780613911472137 and parameters: {'alpha': 16.155111158932158, 'beta': 0.10658106263141519}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:50,923] Trial 131 finished with value: 0.2532867409172786 and parameters: {'alpha': 9.148964244225194, 'beta': 0.12713944293823026}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:51,619] Trial 132 finished with value: 0.25361143548327914 and parameters: {'alpha': 5.472970527325988, 'beta': 0.14387287396014528}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:52,548] Trial 133 finished with value: 0.2532700790866321 and parameters: {'alpha': 10.070895056343646, 'beta': 0.13557550417567038}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:54,326] Trial 134 finished with value: 0.2589689103461413 and parameters: {'alpha': 12.078086457487547, 'beta': 0.1374600613648412}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:55,778] Trial 135 finished with value: 0.3576340195849715 and parameters: {'alpha': 19.756257918796983, 'beta': 0.1818697448270598}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:57,350] Trial 136 finished with value: 0.3992709109661028 and parameters: {'alpha': 14.416595377897531, 'beta': 0.1032241288157985}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:58,832] Trial 137 finished with value: 0.2533031578830658 and parameters: {'alpha': 9.81998005797643, 'beta': 0.15701085665118591}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:01:59,390] Trial 138 finished with value: 0.2536059861000285 and parameters: {'alpha': 5.623996543790711, 'beta': 0.16063881891190152}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:00,427] Trial 139 finished with value: 0.25336897279800236 and parameters: {'alpha': 11.353834942400619, 'beta': 0.14293846474835475}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:01,847] Trial 140 finished with value: 0.2695544649855317 and parameters: {'alpha': 15.290303987462725, 'beta': 0.1826789979373457}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:03,326] Trial 141 finished with value: 0.25330400083279214 and parameters: {'alpha': 9.492482462724384, 'beta': 0.128848454088426}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:05,043] Trial 142 finished with value: 0.25332480023988146 and parameters: {'alpha': 10.659873027086471, 'beta': 0.13074793996063777}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:05,973] Trial 143 finished with value: 0.25340947178940765 and parameters: {'alpha': 6.434620616221363, 'beta': 0.10882637442804856}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:07,008] Trial 144 finished with value: 0.25330865929365315 and parameters: {'alpha': 9.546248344739741, 'beta': 0.13012411698250065}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:08,076] Trial 145 finished with value: 0.25375561763082183 and parameters: {'alpha': 4.677375426003505, 'beta': 0.1456058787720409}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:09,674] Trial 146 finished with value: 0.26654556640843086 and parameters: {'alpha': 12.423487625335408, 'beta': 0.12817319388813747}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:10,563] Trial 147 finished with value: 0.2533109909540539 and parameters: {'alpha': 9.983146825841057, 'beta': 0.15750634993932427}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:11,559] Trial 148 finished with value: 0.2539515039942478 and parameters: {'alpha': 3.40434918917698, 'beta': 0.137958911669742}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:12,102] Trial 149 finished with value: 0.2535640871689526 and parameters: {'alpha': 5.783306173002632, 'beta': 0.10294163200627669}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:13,525] Trial 150 finished with value: 0.34407839072020613 and parameters: {'alpha': 14.546942527159548, 'beta': 0.12987342499026516}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:14,433] Trial 151 finished with value: 0.253317216409408 and parameters: {'alpha': 10.129241608285312, 'beta': 0.15744661121076786}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:15,290] Trial 152 finished with value: 0.2533131952958042 and parameters: {'alpha': 9.230430802030217, 'beta': 0.17533149922274668}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:15,970] Trial 153 finished with value: 0.2535298877071277 and parameters: {'alpha': 6.63520767964585, 'beta': 0.19843724234895488}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:17,558] Trial 154 finished with value: 0.30952592915279464 and parameters: {'alpha': 16.68535060594031, 'beta': 0.17467289678352185}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:20,412] Trial 155 finished with value: 0.2626153969789473 and parameters: {'alpha': 12.739171824849446, 'beta': 0.14509668539041826}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:22,177] Trial 156 finished with value: 0.25332147382179254 and parameters: {'alpha': 9.115681148397758, 'beta': 0.11131305838063167}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:23,069] Trial 157 finished with value: 0.2533882083106872 and parameters: {'alpha': 7.064238871222873, 'beta': 0.13256994420484758}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:23,854] Trial 158 finished with value: 0.25372007625319043 and parameters: {'alpha': 4.812417039350211, 'beta': 0.12370474537199216}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:24,617] Trial 159 finished with value: 0.25337246970867877 and parameters: {'alpha': 7.292991339503591, 'beta': 0.1121658779440554}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:26,230] Trial 160 finished with value: 0.2546194720556451 and parameters: {'alpha': 11.929526674170036, 'beta': 0.14677181339486634}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:27,267] Trial 161 finished with value: 0.25330130543468427 and parameters: {'alpha': 9.506872395163159, 'beta': 0.16267352876402288}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:28,377] Trial 162 finished with value: 0.2533082657291038 and parameters: {'alpha': 9.674888073570697, 'beta': 0.16265310196082008}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:30,250] Trial 163 finished with value: 0.25858283952714917 and parameters: {'alpha': 1.3971947423905897, 'beta': 0.2135827910927805}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:31,000] Trial 164 finished with value: 0.25334666428427743 and parameters: {'alpha': 8.776524869947133, 'beta': 0.13478820109356116}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:32,541] Trial 165 finished with value: 0.26342424373501266 and parameters: {'alpha': 13.539112428355232, 'beta': 0.16079042157358805}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:33,745] Trial 166 finished with value: 0.25360338610749655 and parameters: {'alpha': 5.693002154019977, 'beta': 0.12177714969017436}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:35,629] Trial 167 finished with value: 0.41025084432904807 and parameters: {'alpha': 18.48678999818135, 'beta': 0.10080708517292349}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:36,893] Trial 168 finished with value: 0.25339970437332743 and parameters: {'alpha': 7.072964964180844, 'beta': 0.14131782310478858}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:38,061] Trial 169 finished with value: 0.253329451303299 and parameters: {'alpha': 10.586868084279837, 'beta': 0.12693058872233748}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:40,168] Trial 170 finished with value: 0.2840687966531284 and parameters: {'alpha': 14.566799551382372, 'beta': 0.11483482587479686}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:41,338] Trial 171 finished with value: 0.2533322398552576 and parameters: {'alpha': 9.009482644164182, 'beta': 0.19078365750535142}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:42,440] Trial 172 finished with value: 0.2533489112800544 and parameters: {'alpha': 10.034479150476583, 'beta': 0.1729550970307705}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:43,114] Trial 173 finished with value: 0.25342997369086184 and parameters: {'alpha': 7.290437084723865, 'beta': 0.1538840825683833}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:44,306] Trial 174 finished with value: 0.2551638571692767 and parameters: {'alpha': 11.650660285982163, 'beta': 0.13678708187301908}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:45,828] Trial 175 finished with value: 0.25332628563832676 and parameters: {'alpha': 8.620660827468585, 'beta': 0.16543878788051436}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:47,630] Trial 176 finished with value: 0.2532788641795518 and parameters: {'alpha': 9.275753514482627, 'beta': 0.11741504949556776}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:49,047] Trial 177 finished with value: 0.34443074752293945 and parameters: {'alpha': 13.346490514743023, 'beta': 0.10971836236083465}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:49,760] Trial 178 finished with value: 0.2534932088859636 and parameters: {'alpha': 6.111850961463197, 'beta': 0.12137166096321651}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:51,295] Trial 179 finished with value: 0.4077596224876265 and parameters: {'alpha': 16.411757347788328, 'beta': 0.12839916392665685}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:52,867] Trial 180 finished with value: 0.26590260669466215 and parameters: {'alpha': 11.771212496160683, 'beta': 0.1138673079764496}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:53,821] Trial 181 finished with value: 0.25331734529491773 and parameters: {'alpha': 9.002722498826694, 'beta': 0.14996250215275378}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:54,572] Trial 182 finished with value: 0.25337238523726696 and parameters: {'alpha': 7.865877170955978, 'beta': 0.1392075496734241}. Best is trial 121 with value: 0.2532566276145242.
[I 2022-11-24 19:02:55,531] Trial 183 finished with value: 0.25324973528416034 and parameters: {'alpha': 10.05376277549074, 'beta': 0.12020223194071933}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:02:57,443] Trial 184 finished with value: 0.26198317168403834 and parameters: {'alpha': 10.845060902506406, 'beta': 0.1001976687919939}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:02:58,438] Trial 185 finished with value: 0.2536342366859299 and parameters: {'alpha': 5.261821607321177, 'beta': 0.12488189885213659}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:02:59,072] Trial 186 finished with value: 0.2533692594026924 and parameters: {'alpha': 7.296602044765262, 'beta': 0.10941928852086107}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:00,617] Trial 187 finished with value: 0.3560670790346195 and parameters: {'alpha': 14.054879602402444, 'beta': 0.1192912222908375}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:01,477] Trial 188 finished with value: 0.25327207221075015 and parameters: {'alpha': 10.208588989025143, 'beta': 0.13434295227398071}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:02,161] Trial 189 finished with value: 0.2535062262258342 and parameters: {'alpha': 6.2024015206353615, 'beta': 0.13377259945956593}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:03,246] Trial 190 finished with value: 0.25329163937566085 and parameters: {'alpha': 11.28764104149662, 'beta': 0.14446784029803136}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:04,216] Trial 191 finished with value: 0.2533069829408995 and parameters: {'alpha': 10.373781329323654, 'beta': 0.14855229362409436}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:05,760] Trial 192 finished with value: 0.2539910033920537 and parameters: {'alpha': 11.54503376944966, 'beta': 0.14083502862533093}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:06,617] Trial 193 finished with value: 0.2533443029387987 and parameters: {'alpha': 8.337524607595931, 'beta': 0.1474951115012747}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:10,503] Trial 194 finished with value: 0.5693861687345942 and parameters: {'alpha': 15.966043193777377, 'beta': 0.11711089785362254}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:13,923] Trial 195 finished with value: 0.2688419119489707 and parameters: {'alpha': 12.739485530580632, 'beta': 0.13161513574554096}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:15,782] Trial 196 finished with value: 0.25332261553890845 and parameters: {'alpha': 7.647746603083535, 'beta': 0.10967076683674415}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:18,412] Trial 197 finished with value: 0.25327146821029217 and parameters: {'alpha': 10.302577318467181, 'beta': 0.12527099979209008}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:20,268] Trial 198 finished with value: 0.2534685871914655 and parameters: {'alpha': 11.45196687279293, 'beta': 0.14317879254345106}. Best is trial 183 with value: 0.25324973528416034.
[I 2022-11-24 19:03:21,520] Trial 199 finished with value: 0.25376441627082685 and parameters: {'alpha': 4.341073847537762, 'beta': 0.1202291147506607}. Best is trial 183 with value: 0.25324973528416034.

Используя optuna.visualization.plot_contour, нарисуйте график зависимости step_alpha - step_beta - objective. Используйте аргумент target, чтобы обрезать значения лоссов, которые портят тепловую карту.
Для каждого batch_size выведите такой график в отдельной ячейке.

def clipper_example(frozen_trial):
    max_value = 0.28
    return min(frozen_trial.value, max_value)

optuna.visualization.plot_contour(research_studies[300], params=['alpha', 'beta'], 
                                  target=clipper_example, target_name="Loss")

optuna.visualization.plot_contour(research_studies[1000], params=['alpha', 'beta'], target=clipper_example, target_name="Loss")

optuna.visualization.plot_contour(research_studies[10000], params=['alpha', 'beta'], target=clipper_example, target_name="Loss")

optuna.visualization.plot_contour(research_studies[None], params=['alpha', 'beta'], target=clipper_example, target_name="Loss")

Опишите подробно все свои наблюдения.

Как видно из результатов, самое оптимальное значение альфа равно около 10, так как в районе этого значения при каждом размере батча лосс достигает миниммума.

Что касается бета, то тут не так однозначно. Когда мы не использовали всю выборку для подсчета градиента, оптимальное бета колебалось в районе 3. Но в последнем случае оно равно 0.1. Возможно когда мы считаем градиент по всей выборке, нам не надо сильно снижать шаг, так как мы иначе сократим сходимость. Тем более градиент по всей выборке истинный, а не приближенный как в случае стохастического градиентного спуска, где мы идем к минимуму малыми шагами.

Также можно заметить некоторую положительную корреляцию между альфа и бета. Темные участки на графиках - минимумы, и она идут вдоль диагонали. Это можно объяснить тем, что для данной задачи есть некоторый опимальный шаг для градиентного метода, и если мы увеличиваем альфа, то увеличиваем шаг. Поэтому, чтобы скоррекировать шаг, алгоритм увеличивал и бета, чтобы шаг оставался в оптимальном диапазоне.(увеличение бета - уменьшение шага).

Размер оптимальной зоны уменьшается по мере увеличения batch_size, и область снижается сверху вниз.

Мы поставили довольно большое значение n_startup_trials в TPESampler. Как думаете, для чего?

Чтобы TPESampler мог сгенерировать побольше сэмплов, из которых бы он выбрал лучшие. Таким образом процесс подбора параметров будет сходится к оптимальным. Плюс мы хотим глянуть на теплвые карты и увидеть на них явный миниму(где холодно)

Если же взять меньшее количество n_startup_trials, то нам может не хватить данных, чтобы увидеть наилучшие сэмплы, точнее направление, в котором надо двигаться в процессе генерации новых сэмплов, и процеcc в итоге может выбрать неоптимальные гиперпараметры.

Обучите по модели для каждого batch_size с лучшими step_alpha, step_beta. Соберите историю, сложите все в словари по ключу batch_size.

history_lr = {}
for batch in [300, 1000, 10000, None]:
    loss_func = BinaryLogisticLoss(best_l2)
    params = research_studies[batch].best_trial.params
    model = LinearModel(loss_function=loss_func, batch_size=batch, step_alpha=params['alpha'], step_beta=params['beta'], tolerance=1e-4, max_iter=30, random_seed=911)
    prep = make_pipeline(
            StandardScaler(),
            SimpleImputer(strategy='median')
        )
    
    X_tr, y_tr = prep.fit_transform(data_dict['tr'][best_features]), data_dict['tr'].target
    X_val, y_val = prep.transform(data_dict['val'][best_features]), data_dict['val'].target
    h = model.fit(X_tr, y_tr, w_0 = None, trace=True, X_val=X_val, y_val=y_val)
    history_lr[batch] = h

Визуализируйте результаты эксперимента. Нарисуйте графики time-loss, epoch-loss, epoch-learning_rate для каждого batch_size.
На графике epoch-loss должно быть каким-либо образом отображено среднее время эпохи для каждого размера батча.
Под learning_rate имеется в виду: $$\eta_k = \frac{\alpha}{k^{\beta}}, \quad \text{где $k$ - номер итерации (эпохи)}$$

Убедитесь, что различия между графиками, относящимися к разным batch_size, хорошо видны.

fig, axes = plt.subplots(1,3, constrained_layout=True, figsize=(16,6))
axes[0].set_xlabel('time')
axes[0].set_ylabel('loss')
axes[0].set_yscale('log')

axes[1].set_xlabel('epoch')
axes[1].set_ylabel('loss')
axes[1].set_yscale('log')

axes[2].set_xlabel('epoch')
axes[2].set_ylabel('lr')
axes[2].set_yscale('log')

for batch in [300, 1000, 10000, None]:
    time = np.cumsum(history_lr[batch]['time'])
    axes[0].plot(time[1:], history_lr[batch]['func_val'][1:], label=str(batch))
    mean_epoch = np.mean(history_lr[batch]["time"])
    axes[1].plot(history_lr[batch]['func_val'][1:], label=str(batch) + f' mean-time:{mean_epoch:.3e}')
    alpha, beta = research_studies[batch].best_trial.params['alpha'], research_studies[batch].best_trial.params['beta']
    lrs = [alpha / (i+1)**beta for i in range(len(history_lr[batch]['func']))]
    axes[2].plot(lrs, label=str(batch))
axes[0].legend(loc='upper right',prop={'size': 10})
axes[1].legend(loc='upper right',prop={'size': 10})
axes[2].legend(loc='upper right',prop={'size': 10})
plt.show()

Какие выводы можно сделать из увиденного?

Выбор батча может сыграть существенную роль в обучении модели, так как оптимальный размер сокращает количество времени на эпоху и количество эпох, то есть ускоряет сходимость алгоритма.

В то же время важен и learning-rate. Он должен быть достаточно маленьким, чтобы можно было скатиться в глубокий минимум, в то же время слишком маленький шаг - более долгая сходимость.

Поэтому модель с самым маленьким батчом сходится дольше всех, а с батчом 1000 - лучше всех. Но модель с батчом 1000 сошелся подозрительно быстро. По экспериментам батч должен быть побольше, наверно батчу=1000 просто повезло. Берем как лучший батч 10000.

Часть третья. Метрика (4 балла)

Настало время проверить, во что вылились наши усилия. Посмотрим на метрику sklearn.metrics.balanced_accuracy_score.

Выберите по графикам выше оптимальные параметры для вашей финальной модели. Посчитайте для этой модели значение balanced_accuracy на обучающей, валидационной и тестовой выборках. Используйте model.get_optimal_threshold для подсчета порога бинаризации.

from sklearn.metrics import balanced_accuracy_score

best_batch = 10000
best_alpha, best_beta = research_studies[best_batch].best_trial.params['alpha'], research_studies[best_batch].best_trial.params['beta']
loss_func = BinaryLogisticLoss(best_l2)
prep = make_pipeline(
            StandardScaler(),
            SimpleImputer(strategy='median'))
    
X_tr, y_tr = prep.fit_transform(data_dict['tr'][best_features]), data_dict['tr'].target
X_val, y_val = prep.transform(data_dict['val'][best_features]), data_dict['val'].target
X_tst, y_tst = prep.transform(data_dict['tst'][best_features]), data_dict['tst'].target
model = LinearModel(loss_function=loss_func, batch_size=best_batch, step_alpha=alpha, 
                    step_beta=beta, tolerance=1e-4, max_iter=30, random_seed=911)
model.fit(X_tr, y_tr)
threshold = model.get_optimal_threshold(X_tr, y_tr)
pred_tr = model.predict(X_tr, threshold)
pred_val = model.predict(X_val, threshold)
pred_tst = model.predict(X_tst, threshold)

print("Train score:", balanced_accuracy_score(y_tr, pred_tr))
print("Validation score:", balanced_accuracy_score(y_val, pred_val))
print("Test score:", balanced_accuracy_score(y_tst, pred_tst))

Train score: 0.6635271045062248
Validation score: 0.66676325056318
Test score: 0.662691038110516

Что скажете?

Для поиска оптимального трешхолда мы используем только трейновые данные, чтобы не брать информацию из валидирующей выборки.

Скор оказался неплохим, но можно было бы и лучше) На тесте практически такой же, как на трейне и валидации. Значит мы неплохо обучили нашу модель.

В качестве послесловия предлагается на обсуждение вопрос, который мог возникнуть еще в самом начале экспериментов: почему мы подбираем гиперпараметры по лоссу, если в результате мы хотим получить модель с лучшим показателем метрики balanced_accuracy? Первое, что хочется ответить, так это то, что каждый раз подбирать оптимальный порог и считать метрику дольше, чем просто посчитать лосс.

Замерьте время подсчета лосса и подбора оптимального порога + подсчет метрики, используя %timeit или %%timeit.

w = np.r_[model.get_bias(), model.get_weights()]
%timeit loss_func.func(X_tr, y_tr, w)
%timeit balanced_accuracy_score(y_tr, model.predict(X_tr, model.get_optimal_threshold(X_tr, y_tr)))

18.9 ms ± 11 ms per loop (mean ± std. dev. of 7 runs, 10 loops each)
1.22 s ± 206 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

Подумайте (и напишите), есть ли другие причины, по которым использовать balanced_accuracy в нашем процессе подбора гиперпараметров не стоит?

#Может оптуне сложно было бы подобрать гиперпараметры? было бы много оптимальных наборов...

По логике, уменьшение лосса есть "улучшение качества работы алгоритма", как и увеличение нашей метрики. Может быть, мы имели право перебирать гиперпараметры по лоссу, даже если на самом деле хотели от модели лишь balanced_accuracy побольше?

Давайте проверим. Напишите функцию multiobjective, которая перебирает step_alpha, step_beta. Зафиксируйте все остальное на адекватных значениях, согласно предыдущим экспериментам. Функция должна возвращать tuple (loss, balanced_acc_score) - лосс и balanced_accuracy_score с подбором оптимального порога, полученные на валидации.

def multiobjective(trial, X_tr, y_tr, X_val, y_val,**kwargs):
    step_alpha = trial.suggest_float('alpha',1e-3, 20, log=True)
    step_beta = trial.suggest_float('beta',0.1, 5, log=True)
    
    loss_func = BinaryLogisticLoss(best_l2)
    model = LinearModel(loss_function=loss_func, batch_size=best_batch, step_alpha=step_alpha, step_beta=step_beta, tolerance=1e-4, max_iter=30, random_seed=911)
    model.fit(X_tr, y_tr)
    
    loss = BinaryLogisticLoss(0).func(X_val, y_val, np.r_[model.get_bias(), model.get_weights()])
    threshold = model.get_optimal_threshold(X_val, y_val)
    pred = model.predict(X_val, threshold)
    score = balanced_accuracy_score(y_val, pred)
    
    return loss, score

Optuna позволяет оптимизировать multiobjective-функции, которые возвращают больше одного аргумента.

Запустите сессию оптимизации с сэмплером по умолчанию. Используйте 100-300 n_trials, study_directions = ['minimize', 'maximize'].

multistudy = start_optimization(objective_func=multiobjective, n_trials=200, n_jobs=-1, data_dict = data_dict,
    study_direction=None, study_directions=['minimize', 'maximize'], sampler=None, prep=None, features=features)

[I 2022-11-24 19:24:14,924] A new study created in memory with name: no-name-8299db10-eff7-4f40-8b88-130e92c4dcc8
[I 2022-11-24 19:24:33,645] Trial 0 finished with values: [0.437104248113277, 0.6108139795537499] and parameters: {'alpha': 0.007274189918729047, 'beta': 0.2856624763155263}. 
[I 2022-11-24 19:24:37,656] Trial 1 finished with values: [0.2542967263425302, 0.6711517397225499] and parameters: {'alpha': 2.1346981319925447, 'beta': 2.129939106135318}. 
[I 2022-11-24 19:24:49,524] Trial 2 finished with values: [0.42684132561699745, 0.6118257972543268] and parameters: {'alpha': 0.0052204003390473545, 'beta': 0.10596893024734233}. 
[I 2022-11-24 19:24:53,854] Trial 3 finished with values: [0.2542839531881175, 0.6706688746248964] and parameters: {'alpha': 2.4328119029439472, 'beta': 2.730931766183869}. 
[I 2022-11-24 19:24:58,792] Trial 4 finished with values: [0.2573464208747521, 0.6685502893466455] and parameters: {'alpha': 5.735119719967214, 'beta': 2.617052898378201}. 
[I 2022-11-24 19:25:18,426] Trial 5 finished with values: [0.47481623889449825, 0.6039747257787256] and parameters: {'alpha': 0.03156762098176633, 'beta': 1.3779998266085935}. 
[I 2022-11-24 19:25:36,220] Trial 6 finished with values: [0.44426460241772353, 0.6096790368833458] and parameters: {'alpha': 0.02061421411736351, 'beta': 0.8484971459005316}. 
[I 2022-11-24 19:25:49,079] Trial 7 finished with values: [0.3809832688498954, 0.6206601813202376] and parameters: {'alpha': 0.06571986265774771, 'beta': 1.2965989809047695}. 
[I 2022-11-24 19:25:59,307] Trial 8 finished with values: [0.6750329251960573, 0.5801754431073163] and parameters: {'alpha': 0.0010281191234071138, 'beta': 1.2439614176610094}. 
[I 2022-11-24 19:26:02,647] Trial 9 finished with values: [0.26272034628333296, 0.6610753031371144] and parameters: {'alpha': 1.0197663452801207, 'beta': 3.047587271172075}. 
[I 2022-11-24 19:26:13,965] Trial 10 finished with values: [0.6472969406194955, 0.582404114572626] and parameters: {'alpha': 0.001304462527935146, 'beta': 0.7135406087408369}. 
[I 2022-11-24 19:26:28,316] Trial 11 finished with values: [0.26015159109355906, 0.6642247482514367] and parameters: {'alpha': 0.06445085361791682, 'beta': 0.1115086320861191}. 
[I 2022-11-24 19:26:34,088] Trial 12 finished with values: [0.6694477252447991, 0.580677490010808] and parameters: {'alpha': 0.002417322255540112, 'beta': 1.9192940998654362}. 
[I 2022-11-24 19:26:37,535] Trial 13 finished with values: [0.6651002665936847, 0.5809133425440116] and parameters: {'alpha': 0.004095087775179436, 'beta': 3.230807537737483}. 
[I 2022-11-24 19:26:48,515] Trial 14 finished with values: [0.5975217270783156, 0.5870219090633487] and parameters: {'alpha': 0.0015634117732368773, 'beta': 0.3389126570999566}. 
[I 2022-11-24 19:26:59,911] Trial 15 finished with values: [0.26475675843469376, 0.6602711492807829] and parameters: {'alpha': 0.04975548666162731, 'beta': 0.11674240435589693}. 
[I 2022-11-24 19:27:13,244] Trial 16 finished with values: [0.4480639472926748, 0.6089748227198322] and parameters: {'alpha': 0.007714020096370925, 'beta': 0.35428631872216515}. 
[I 2022-11-24 19:27:26,469] Trial 17 finished with values: [0.25617449155170235, 0.6689328612495502] and parameters: {'alpha': 0.21954311675970148, 'beta': 0.4736910460937065}. 
[I 2022-11-24 19:27:30,807] Trial 18 finished with values: [0.25343482605298745, 0.673746489630032] and parameters: {'alpha': 0.7350074010068149, 'beta': 0.13371613816311284}. 
[I 2022-11-24 19:27:41,366] Trial 19 finished with values: [0.30691575045560526, 0.6559485004741017] and parameters: {'alpha': 16.624716058167557, 'beta': 0.32410921761120237}. 
[I 2022-11-24 19:27:51,862] Trial 20 finished with values: [0.4310335599882441, 0.6111411876157437] and parameters: {'alpha': 0.005799932392780431, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:27:54,018] Trial 21 finished with values: [0.6730615610845513, 0.5803108862598216] and parameters: {'alpha': 0.003096958078497201, 'beta': 4.304081520468186}. 
[I 2022-11-24 19:27:58,284] Trial 22 finished with values: [0.25338481591756973, 0.6739517073892363] and parameters: {'alpha': 0.7581694865599075, 'beta': 0.10326262112200245}. 
[I 2022-11-24 19:27:59,946] Trial 23 finished with values: [0.2551618732388654, 0.6686535119105443] and parameters: {'alpha': 3.2959408900415093, 'beta': 4.835848788947858}. 
[I 2022-11-24 19:28:01,828] Trial 24 finished with values: [0.2577762131232464, 0.6669246736355839] and parameters: {'alpha': 1.6330587434716772, 'beta': 4.806087323549834}. 
[I 2022-11-24 19:28:04,822] Trial 25 finished with values: [0.25337288663355, 0.6739428117479825] and parameters: {'alpha': 1.3821115743627232, 'beta': 0.24993017626972486}. 
[I 2022-11-24 19:28:09,301] Trial 26 finished with values: [0.25441372453055294, 0.6718704017324739] and parameters: {'alpha': 1.07104762920486, 'beta': 0.9963011367887795}. 
[I 2022-11-24 19:28:20,292] Trial 27 finished with values: [0.5341038948716964, 0.5944369272547187] and parameters: {'alpha': 0.027440875262208658, 'beta': 1.9465171966878432}. 
[I 2022-11-24 19:28:23,529] Trial 28 finished with values: [0.2535575486135302, 0.6728199499442749] and parameters: {'alpha': 4.073648303930675, 'beta': 0.3266991800239032}. 
[I 2022-11-24 19:28:34,743] Trial 29 finished with values: [0.5005927465038654, 0.5993982613494508] and parameters: {'alpha': 0.002751197440604704, 'beta': 0.10911486295856108}. 
[I 2022-11-24 19:28:38,676] Trial 30 finished with values: [0.2543038611400507, 0.6715887830593925] and parameters: {'alpha': 4.992409469602199, 'beta': 0.20933637566289817}. 
[I 2022-11-24 19:28:50,660] Trial 31 finished with values: [0.3666555080804067, 0.6238717562529925] and parameters: {'alpha': 0.010536029303157104, 'beta': 0.17391228241793388}. 
[I 2022-11-24 19:29:04,629] Trial 32 finished with values: [0.2804627925716687, 0.6505771498719914] and parameters: {'alpha': 0.08230086750279296, 'beta': 0.5806282405057105}. 
[I 2022-11-24 19:29:09,299] Trial 33 finished with values: [0.2533717519610182, 0.6731316966228529] and parameters: {'alpha': 4.0571873629256405, 'beta': 0.4272428995980241}. 
[I 2022-11-24 19:29:21,726] Trial 34 finished with values: [0.5214830545892731, 0.5959758188066968] and parameters: {'alpha': 0.0025248525035454885, 'beta': 0.15717123849804418}. 
[I 2022-11-24 19:29:34,750] Trial 35 finished with values: [0.2669794492783708, 0.658546654382697] and parameters: {'alpha': 0.04409828337434197, 'beta': 0.10761934505213613}. 
[I 2022-11-24 19:29:39,314] Trial 36 finished with values: [0.5284326691923454, 0.594902317491174] and parameters: {'alpha': 0.04264852432879433, 'beta': 3.5136980166266754}. 
[I 2022-11-24 19:29:42,577] Trial 37 finished with values: [0.25335552884915763, 0.6740504938747052] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.22212492579410245}. 
[I 2022-11-24 19:29:51,090] Trial 38 finished with values: [0.6699504263059468, 0.5805799543783262] and parameters: {'alpha': 0.002035115165065016, 'beta': 1.6759406226356883}. 
[I 2022-11-24 19:29:55,763] Trial 39 finished with values: [0.25339226727176056, 0.6742788783706078] and parameters: {'alpha': 1.031845023636924, 'beta': 0.1570187404492478}. 
[I 2022-11-24 19:30:06,931] Trial 40 finished with values: [0.5006838380734284, 0.6400622238054494] and parameters: {'alpha': 18.275313653128585, 'beta': 1.8181813787934695}. 
[I 2022-11-24 19:30:24,381] Trial 41 finished with values: [0.5739621389840154, 0.5897829507289231] and parameters: {'alpha': 0.004566964698025192, 'beta': 0.7149762402397595}. 
[I 2022-11-24 19:30:48,831] Trial 42 finished with values: [0.4896593927821302, 0.6013035564170555] and parameters: {'alpha': 0.005693461446180457, 'beta': 0.3826354950344001}. 
[I 2022-11-24 19:31:01,826] Trial 43 finished with values: [0.26183975854709224, 0.6622420337888666] and parameters: {'alpha': 0.0759386306142015, 'beta': 0.2293556171051637}. 
[I 2022-11-24 19:31:12,900] Trial 44 finished with values: [0.31524660615620387, 0.6373552110783887] and parameters: {'alpha': 0.037552475472550306, 'beta': 0.48897473344748876}. 
[I 2022-11-24 19:31:17,254] Trial 45 finished with values: [0.253395359916146, 0.6738824024704179] and parameters: {'alpha': 0.8396895422315906, 'beta': 0.19591599139037236}. 
[I 2022-11-24 19:31:22,606] Trial 46 finished with values: [0.25348048526379624, 0.6730010430507086] and parameters: {'alpha': 4.194144096183795, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:31:36,958] Trial 47 finished with values: [0.32913597375372794, 0.6550052905766468] and parameters: {'alpha': 8.941672602625346, 'beta': 2.176349203911218}. 
[I 2022-11-24 19:31:54,750] Trial 48 finished with values: [0.2887840465206664, 0.6462996998716691] and parameters: {'alpha': 0.024256972322444906, 'beta': 0.10549916576916454}. 
[I 2022-11-24 19:32:08,002] Trial 49 finished with values: [0.2533896556355321, 0.674002244569164] and parameters: {'alpha': 0.8500546352815807, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:32:11,080] Trial 50 finished with values: [0.2533151114827691, 0.6738005840776446] and parameters: {'alpha': 1.7238555049512394, 'beta': 0.2856624763155263}. 
[I 2022-11-24 19:32:22,405] Trial 51 finished with values: [0.3032010310413744, 0.6409899302947835] and parameters: {'alpha': 0.03156762098176633, 'beta': 0.3266991800239032}. 
[I 2022-11-24 19:32:25,322] Trial 52 finished with values: [0.2540441919033148, 0.6722002511707854] and parameters: {'alpha': 4.194144096183795, 'beta': 0.1860892412522232}. 
[I 2022-11-24 19:32:35,358] Trial 53 finished with values: [0.5628881557190865, 0.5905819244223403] and parameters: {'alpha': 0.0025248525035454885, 'beta': 0.3520133270829882}. 
[I 2022-11-24 19:32:45,864] Trial 54 finished with values: [0.3666555080804067, 0.6238717562529925] and parameters: {'alpha': 0.010536029303157104, 'beta': 0.17391228241793388}. 
[I 2022-11-24 19:32:55,410] Trial 55 finished with values: [0.2551347622460691, 0.6702742169112126] and parameters: {'alpha': 0.27710380051810557, 'beta': 0.4736910460937065}. 
[I 2022-11-24 19:33:11,935] Trial 56 finished with values: [0.26080373547760255, 0.6580527590359748] and parameters: {'alpha': 7.791368171516604, 'beta': 0.15717123849804418}. 
[I 2022-11-24 19:33:41,461] Trial 57 finished with values: [0.26183975854709224, 0.6622420337888666] and parameters: {'alpha': 0.0759386306142015, 'beta': 0.2293556171051637}. 
[I 2022-11-24 19:34:05,259] Trial 58 finished with values: [0.4041830346788638, 0.6162860003369343] and parameters: {'alpha': 0.010536029303157104, 'beta': 0.32410921761120237}. 
[I 2022-11-24 19:34:09,010] Trial 59 finished with values: [0.25356413452070103, 0.6744031009268507] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.7006088199240066}. 
[I 2022-11-24 19:34:11,626] Trial 60 finished with values: [0.25350265621905316, 0.6736682519893378] and parameters: {'alpha': 3.2959408900415093, 'beta': 1.7724479826405115}. 
[I 2022-11-24 19:34:14,095] Trial 61 finished with values: [0.2541504796797624, 0.6712757855278272] and parameters: {'alpha': 2.5389535130387006, 'beta': 2.617052898378201}. 
[I 2022-11-24 19:34:18,121] Trial 62 finished with values: [0.25317091904598116, 0.6735834807430205] and parameters: {'alpha': 4.073648303930675, 'beta': 0.6594492438312234}. 
[I 2022-11-24 19:34:29,595] Trial 63 finished with values: [0.6531546850018571, 0.5816631460964374] and parameters: {'alpha': 0.002573731285824864, 'beta': 1.2965989809047695}. 
[I 2022-11-24 19:34:33,359] Trial 64 finished with values: [0.25338219277497737, 0.6741203661270425] and parameters: {'alpha': 1.0197663452801207, 'beta': 0.12292271244823506}. 
[I 2022-11-24 19:34:38,731] Trial 65 finished with values: [0.6613134250804339, 0.5813151753580814] and parameters: {'alpha': 0.0037445144419542995, 'beta': 2.1901482434942703}. 
[I 2022-11-24 19:34:42,240] Trial 66 finished with values: [0.2573464208747521, 0.6685502893466455] and parameters: {'alpha': 5.735119719967214, 'beta': 2.617052898378201}. 
[I 2022-11-24 19:34:46,004] Trial 67 finished with values: [0.2533687392570521, 0.6739199379481993] and parameters: {'alpha': 1.031845023636924, 'beta': 0.10158542505098958}. 
[I 2022-11-24 19:34:57,030] Trial 68 finished with values: [0.4182141673363886, 0.6137826850635697] and parameters: {'alpha': 0.010536029303157104, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:35:08,132] Trial 69 finished with values: [0.5606363702534716, 0.5904724241091115] and parameters: {'alpha': 0.008408783792309278, 'beta': 0.9919136856074681}. 
[I 2022-11-24 19:35:10,430] Trial 70 finished with values: [0.25400131032778944, 0.6721077238943354] and parameters: {'alpha': 3.2959408900415093, 'beta': 2.7485638189780044}. 
[I 2022-11-24 19:35:20,959] Trial 71 finished with values: [0.25481312709285575, 0.6712491220884601] and parameters: {'alpha': 0.21954311675970148, 'beta': 0.33592638551938514}. 
[I 2022-11-24 19:35:23,525] Trial 72 finished with values: [0.3416668112158519, 0.6301120133658734] and parameters: {'alpha': 0.25121191396185605, 'beta': 4.806087323549834}. 
[I 2022-11-24 19:35:30,757] Trial 73 finished with values: [0.25427963145697674, 0.6728036282904253] and parameters: {'alpha': 8.941672602625346, 'beta': 0.32410921761120237}. 
[I 2022-11-24 19:35:41,452] Trial 74 finished with values: [0.2589033398618018, 0.6656655318933311] and parameters: {'alpha': 0.07032525283229757, 'beta': 0.10596893024734233}. 
[I 2022-11-24 19:35:49,497] Trial 75 finished with values: [0.4947776819425243, 0.600257425544762] and parameters: {'alpha': 0.04409828337434197, 'beta': 2.141365264971215}. 
[I 2022-11-24 19:35:52,712] Trial 76 finished with values: [0.25381641087842766, 0.6727225119574315] and parameters: {'alpha': 4.073648303930675, 'beta': 0.2293556171051637}. 
[I 2022-11-24 19:36:03,472] Trial 77 finished with values: [0.43576948654995024, 0.6108093852646655] and parameters: {'alpha': 0.010536029303157104, 'beta': 0.450511618612121}. 
[I 2022-11-24 19:36:06,671] Trial 78 finished with values: [0.2535575486135302, 0.6728199499442749] and parameters: {'alpha': 4.073648303930675, 'beta': 0.3266991800239032}. 
[I 2022-11-24 19:36:13,592] Trial 79 finished with values: [0.3250734226127803, 0.6337952142597083] and parameters: {'alpha': 0.21748427167243223, 'beta': 2.1883316240078994}. 
[I 2022-11-24 19:36:25,457] Trial 80 finished with values: [0.3089620581900113, 0.6388392640982694] and parameters: {'alpha': 0.030912923834860318, 'beta': 0.35614214519202686}. 
[I 2022-11-24 19:36:36,134] Trial 81 finished with values: [0.5464308785693991, 0.5923738875124274] and parameters: {'alpha': 0.0035775911981476925, 'beta': 0.4272428995980241}. 
[I 2022-11-24 19:36:46,949] Trial 82 finished with values: [0.2799204866435538, 0.6508092683865445] and parameters: {'alpha': 0.02954413202314628, 'beta': 0.10761934505213613}. 
[I 2022-11-24 19:36:51,191] Trial 83 finished with values: [0.25360438838330374, 0.6747671238665353] and parameters: {'alpha': 1.0817172340574543, 'beta': 0.5806282405057105}. 
[I 2022-11-24 19:36:57,919] Trial 84 finished with values: [0.25600079452048546, 0.6695376474328317] and parameters: {'alpha': 0.6452936112915246, 'beta': 0.9963011367887795}. 
[I 2022-11-24 19:37:08,718] Trial 85 finished with values: [0.2556017264305389, 0.6697525605387075] and parameters: {'alpha': 0.21954311675970148, 'beta': 0.4272428995980241}. 
[I 2022-11-24 19:37:11,298] Trial 86 finished with values: [0.25426853938324173, 0.6719407065920697] and parameters: {'alpha': 3.2959408900415093, 'beta': 3.269895496276579}. 
[I 2022-11-24 19:37:14,568] Trial 87 finished with values: [0.27545907909518513, 0.6529526062161011] and parameters: {'alpha': 0.6265172604024741, 'beta': 3.047587271172075}. 
[I 2022-11-24 19:37:25,090] Trial 88 finished with values: [0.266125519839238, 0.659293760937872] and parameters: {'alpha': 0.23641069184534244, 'beta': 0.9292186107171196}. 
[I 2022-11-24 19:37:35,514] Trial 89 finished with values: [0.5636186746216297, 0.5906344750800507] and parameters: {'alpha': 0.017719610097645888, 'beta': 1.7587249618528873}. 
[I 2022-11-24 19:37:39,225] Trial 90 finished with values: [0.25336963691719605, 0.6739624397573072] and parameters: {'alpha': 1.031845023636924, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:37:42,073] Trial 91 finished with values: [0.6749306751235349, 0.5801551501188347] and parameters: {'alpha': 0.002417322255540112, 'beta': 2.80957439220546}. 
[I 2022-11-24 19:37:44,794] Trial 92 finished with values: [0.2537777349262633, 0.6731208480688327] and parameters: {'alpha': 2.377340302826933, 'beta': 1.6759406226356883}. 
[I 2022-11-24 19:37:55,283] Trial 93 finished with values: [0.26475675843469376, 0.6602711492807829] and parameters: {'alpha': 0.04975548666162731, 'beta': 0.11674240435589693}. 
[I 2022-11-24 19:38:05,922] Trial 94 finished with values: [0.3238439803015939, 0.6341371260244051] and parameters: {'alpha': 0.1638272022441971, 'beta': 1.649350846155955}. 
[I 2022-11-24 19:38:08,787] Trial 95 finished with values: [0.25333297202613325, 0.6737989611824152] and parameters: {'alpha': 2.240494651098427, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:38:20,704] Trial 96 finished with values: [0.6550044048432169, 0.5815138224310408] and parameters: {'alpha': 0.0025542369882017237, 'beta': 1.3406558656795255}. 
[I 2022-11-24 19:38:24,340] Trial 97 finished with values: [0.253372062770297, 0.6740438861078382] and parameters: {'alpha': 1.0813357629945717, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:38:35,090] Trial 98 finished with values: [0.6298794274698369, 0.5842223925442319] and parameters: {'alpha': 0.004460206273276189, 'beta': 1.2965989809047695}. 
[I 2022-11-24 19:38:37,688] Trial 99 finished with values: [0.2637946508054583, 0.6605961300334062] and parameters: {'alpha': 1.031845023636924, 'beta': 3.710777578042752}. 
[I 2022-11-24 19:38:48,386] Trial 100 finished with values: [0.30444309912579065, 0.6404967184675294] and parameters: {'alpha': 0.12835572138983076, 'beta': 1.1326899385794966}. 
[I 2022-11-24 19:38:58,987] Trial 101 finished with values: [0.3974254449106405, 0.6540360537905052] and parameters: {'alpha': 10.004615933682288, 'beta': 2.3879551005565887}. 
[I 2022-11-24 19:39:04,164] Trial 102 finished with values: [0.25332730204902015, 0.6740263877622457] and parameters: {'alpha': 1.6330587434716772, 'beta': 0.3266991800239032}. 
[I 2022-11-24 19:39:07,645] Trial 103 finished with values: [0.25336963691719605, 0.6739624397573072] and parameters: {'alpha': 1.031845023636924, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:39:18,108] Trial 104 finished with values: [0.255086350977498, 0.6720844780523099] and parameters: {'alpha': 4.992409469602199, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:39:20,844] Trial 105 finished with values: [0.25324177119328184, 0.6740151857062944] and parameters: {'alpha': 3.2959408900415093, 'beta': 0.63495933102907}. 
[I 2022-11-24 19:39:24,446] Trial 106 finished with values: [0.2539485754760246, 0.6731980116075054] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.9963011367887795}. 
[I 2022-11-24 19:39:29,844] Trial 107 finished with values: [0.3451625911207165, 0.6525401572199098] and parameters: {'alpha': 8.330021149932655, 'beta': 2.992936168653092}. 
[I 2022-11-24 19:39:40,517] Trial 108 finished with values: [0.5734975996266407, 0.5897351896515736] and parameters: {'alpha': 0.0020206878824044127, 'beta': 0.3093885872842006}. 
[I 2022-11-24 19:39:46,710] Trial 109 finished with values: [0.2542276388346666, 0.6723664082026173] and parameters: {'alpha': 0.5924304531589718, 'beta': 0.5789136836611269}. 
[I 2022-11-24 19:39:57,133] Trial 110 finished with values: [0.47627296992062057, 0.6038374038746981] and parameters: {'alpha': 0.003779310388218406, 'beta': 0.14960968378180198}. 
[I 2022-11-24 19:40:01,464] Trial 111 finished with values: [0.2533915847460496, 0.6739192544287309] and parameters: {'alpha': 0.8396895422315906, 'beta': 0.19168335927960659}. 
[I 2022-11-24 19:40:04,619] Trial 112 finished with values: [0.2533774897802754, 0.6740937583086086] and parameters: {'alpha': 1.7238555049512394, 'beta': 0.5819441585681121}. 
[I 2022-11-24 19:40:15,104] Trial 113 finished with values: [0.34221482762087013, 0.6488661869289487] and parameters: {'alpha': 19.933464282323175, 'beta': 1.567777830200285}. 
[I 2022-11-24 19:40:23,217] Trial 114 finished with values: [0.25600079452048546, 0.6695376474328317] and parameters: {'alpha': 0.6452936112915246, 'beta': 0.9963011367887795}. 
[I 2022-11-24 19:40:27,624] Trial 115 finished with values: [0.2528645311759713, 0.6743092152636092] and parameters: {'alpha': 12.97150457524179, 'beta': 1.028348156175332}. 
[I 2022-11-24 19:40:35,715] Trial 116 finished with values: [0.3124818451768827, 0.655579669413745] and parameters: {'alpha': 11.837679845771122, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:40:39,636] Trial 117 finished with values: [0.2533896556355321, 0.674002244569164] and parameters: {'alpha': 0.8500546352815807, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:40:46,794] Trial 118 finished with values: [0.25449178072874074, 0.6718662400506479] and parameters: {'alpha': 6.420218146457296, 'beta': 0.2074630576419567}. 
[I 2022-11-24 19:40:57,221] Trial 119 finished with values: [0.2725995042182703, 0.6551851699107156] and parameters: {'alpha': 0.04449581453768579, 'beta': 0.19591599139037236}. 
[I 2022-11-24 19:41:01,617] Trial 120 finished with values: [0.2535519289068739, 0.6743422219614054] and parameters: {'alpha': 0.6162194101704072, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:41:04,644] Trial 121 finished with values: [0.25323374943860183, 0.6737434391308498] and parameters: {'alpha': 4.073648303930675, 'beta': 0.6755698587620135}. 
[I 2022-11-24 19:41:08,057] Trial 122 finished with values: [0.253372062770297, 0.6740438861078382] and parameters: {'alpha': 1.0813357629945717, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:41:18,778] Trial 123 finished with values: [0.27486599925972355, 0.6536708961837827] and parameters: {'alpha': 0.03499315659188075, 'beta': 0.12292271244823506}. 
[I 2022-11-24 19:41:20,936] Trial 124 finished with values: [0.25422252561207953, 0.6713322654954648] and parameters: {'alpha': 2.240494651098427, 'beta': 2.149042485735167}. 
[I 2022-11-24 19:41:24,257] Trial 125 finished with values: [0.2538330663983901, 0.673538672519215] and parameters: {'alpha': 1.7238555049512394, 'beta': 1.1321646536661607}. 
[I 2022-11-24 19:41:28,663] Trial 126 finished with values: [0.26081992016053424, 0.6630805144131426] and parameters: {'alpha': 0.8500546352815807, 'beta': 1.921473618642331}. 
[I 2022-11-24 19:41:31,403] Trial 127 finished with values: [0.2531759304286252, 0.6737329440787607] and parameters: {'alpha': 4.545227645653379, 'beta': 1.3703301110897885}. 
[I 2022-11-24 19:41:34,343] Trial 128 finished with values: [0.25333297202613325, 0.6737989611824152] and parameters: {'alpha': 2.240494651098427, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:41:44,607] Trial 129 finished with values: [0.31942170978410694, 0.6359150133103242] and parameters: {'alpha': 0.15296426441014985, 'beta': 1.4935388179487552}. 
[I 2022-11-24 19:41:55,055] Trial 130 finished with values: [0.2593780035893787, 0.6652036618439388] and parameters: {'alpha': 0.1542942533828785, 'beta': 0.4736910460937065}. 
[I 2022-11-24 19:42:05,595] Trial 131 finished with values: [0.2632972405833814, 0.6662001294029665] and parameters: {'alpha': 8.941672602625346, 'beta': 0.18462759764542647}. 
[I 2022-11-24 19:42:07,898] Trial 132 finished with values: [0.2568079017695189, 0.6675290642922294] and parameters: {'alpha': 1.69968610597998, 'beta': 3.710777578042752}. 
[I 2022-11-24 19:42:10,589] Trial 133 finished with values: [0.2719143242060156, 0.655305365511393] and parameters: {'alpha': 0.7581694865599075, 'beta': 3.940189031063652}. 
[I 2022-11-24 19:42:22,154] Trial 134 finished with values: [0.3864878832390786, 0.619386414980609] and parameters: {'alpha': 0.009504726115704316, 'beta': 0.20933637566289817}. 
[I 2022-11-24 19:42:26,186] Trial 135 finished with values: [0.25735760991144674, 0.6675585273185687] and parameters: {'alpha': 1.0813357629945717, 'beta': 1.7724479826405115}. 
[I 2022-11-24 19:42:36,830] Trial 136 finished with values: [0.2601261573356066, 0.6643361643968098] and parameters: {'alpha': 0.2862901704290945, 'beta': 0.838259939879373}. 
[I 2022-11-24 19:42:47,423] Trial 137 finished with values: [0.4360898567042629, 0.6107633447281838] and parameters: {'alpha': 0.040302018787154975, 'beta': 1.2912703653665758}. 
[I 2022-11-24 19:42:57,872] Trial 138 finished with values: [0.6028910843198959, 0.5867456658444583] and parameters: {'alpha': 0.001819871824268162, 'beta': 0.44637335713366144}. 
[I 2022-11-24 19:43:02,461] Trial 139 finished with values: [0.25438435705234014, 0.6718730801894138] and parameters: {'alpha': 1.0817172340574543, 'beta': 0.9963011367887795}. 
[I 2022-11-24 19:43:12,960] Trial 140 finished with values: [0.5473896028067327, 0.5922328921547655] and parameters: {'alpha': 0.021491477043515318, 'beta': 1.7724479826405115}. 
[I 2022-11-24 19:43:16,081] Trial 141 finished with values: [0.25335552884915763, 0.6740504938747052] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.22212492579410245}. 
[I 2022-11-24 19:43:26,755] Trial 142 finished with values: [0.5242976887797789, 0.5956618398746654] and parameters: {'alpha': 0.002718333528921245, 'beta': 0.20049806670897033}. 
[I 2022-11-24 19:43:37,143] Trial 143 finished with values: [0.5790884599435191, 0.589571515785405] and parameters: {'alpha': 0.002433864530623512, 'beta': 0.4272428995980241}. 
[I 2022-11-24 19:43:40,356] Trial 144 finished with values: [0.25346016133980803, 0.6728084549514084] and parameters: {'alpha': 3.6856324356147083, 'beta': 0.33592638551938514}. 
[I 2022-11-24 19:43:43,913] Trial 145 finished with values: [0.3425014691835512, 0.630168200396596] and parameters: {'alpha': 0.22593509255960964, 'beta': 3.269895496276579}. 
[I 2022-11-24 19:43:47,405] Trial 146 finished with values: [0.25335160746912994, 0.6740013842987302] and parameters: {'alpha': 1.2991043529257906, 'beta': 0.3266991800239032}. 
[I 2022-11-24 19:43:52,433] Trial 147 finished with values: [0.25393021454050524, 0.6738221884841298] and parameters: {'alpha': 0.7581694865599075, 'beta': 0.5806282405057105}. 
[I 2022-11-24 19:43:55,377] Trial 148 finished with values: [0.2614305731832124, 0.6622861350088098] and parameters: {'alpha': 1.0813357629945717, 'beta': 2.918616167106449}. 
[I 2022-11-24 19:43:57,847] Trial 149 finished with values: [0.6776098870461815, 0.5799742523036775] and parameters: {'alpha': 0.002181987878142419, 'beta': 3.269895496276579}. 
[I 2022-11-24 19:44:04,094] Trial 150 finished with values: [0.2542276388346666, 0.6723664082026173] and parameters: {'alpha': 0.5924304531589718, 'beta': 0.5789136836611269}. 
[I 2022-11-24 19:44:06,897] Trial 151 finished with values: [0.2548953076968807, 0.6705540965031151] and parameters: {'alpha': 1.7238555049512394, 'beta': 1.9108699626768575}. 
[I 2022-11-24 19:44:10,819] Trial 152 finished with values: [0.25487470323083566, 0.6708315905749929] and parameters: {'alpha': 1.2991043529257906, 'beta': 1.3511200456115282}. 
[I 2022-11-24 19:44:13,815] Trial 153 finished with values: [0.2532594306587344, 0.673991158699162] and parameters: {'alpha': 3.313731317883869, 'beta': 0.5806282405057105}. 
[I 2022-11-24 19:44:17,296] Trial 154 finished with values: [0.2533240171413105, 0.6741051556558367] and parameters: {'alpha': 1.7238555049512394, 'beta': 0.4351052677116056}. 
[I 2022-11-24 19:44:22,792] Trial 155 finished with values: [0.2535519289068739, 0.6743422219614054] and parameters: {'alpha': 0.6162194101704072, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:44:26,483] Trial 156 finished with values: [0.2534455789938001, 0.6737598819147317] and parameters: {'alpha': 0.8500546352815807, 'beta': 0.17416955969752895}. 
[I 2022-11-24 19:44:36,809] Trial 157 finished with values: [0.4014852211445118, 0.6165455869403551] and parameters: {'alpha': 0.009397810729690167, 'beta': 0.2627469585192375}. 
[I 2022-11-24 19:44:40,393] Trial 158 finished with values: [0.2535754059003134, 0.6726647255158735] and parameters: {'alpha': 5.674388308226946, 'beta': 1.6745944903960637}. 
[I 2022-11-24 19:44:42,840] Trial 159 finished with values: [0.25350265621905316, 0.6736682519893378] and parameters: {'alpha': 3.2959408900415093, 'beta': 1.7724479826405115}. 
[I 2022-11-24 19:44:46,417] Trial 160 finished with values: [0.2535227463605413, 0.6741695733486559] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.6594492438312234}. 
[I 2022-11-24 19:44:51,296] Trial 161 finished with values: [0.25354760081829436, 0.6743405014205377] and parameters: {'alpha': 0.5924304531589718, 'beta': 0.18973422221495295}. 
[I 2022-11-24 19:44:55,742] Trial 162 finished with values: [0.2528645311759713, 0.6743092152636092] and parameters: {'alpha': 12.97150457524179, 'beta': 1.028348156175332}. 
[I 2022-11-24 19:45:14,127] Trial 163 finished with values: [0.4174045101987939, 0.6137929292034489] and parameters: {'alpha': 0.02012412572917277, 'beta': 0.7006088199240066}. 
[I 2022-11-24 19:45:31,654] Trial 164 finished with values: [0.26849431416785546, 0.6576477409964622] and parameters: {'alpha': 0.11748536499505682, 'beta': 0.5819441585681121}. 
[I 2022-11-24 19:45:34,069] Trial 165 finished with values: [0.25635570887667847, 0.6676330729653176] and parameters: {'alpha': 1.7238555049512394, 'beta': 3.22986272449568}. 
[I 2022-11-24 19:45:39,246] Trial 166 finished with values: [0.35627983227364035, 0.6260565588702575] and parameters: {'alpha': 0.19407202320045544, 'beta': 3.2000239220004247}. 
[I 2022-11-24 19:45:50,723] Trial 167 finished with values: [0.2548990211231356, 0.6721493839733206] and parameters: {'alpha': 5.873819873549243, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:45:54,867] Trial 168 finished with values: [0.2535237064929573, 0.6742986040255707] and parameters: {'alpha': 1.0197663452801207, 'beta': 0.40429701199660706}. 
[I 2022-11-24 19:46:07,988] Trial 169 finished with values: [0.25399351587234253, 0.6734178725043966] and parameters: {'alpha': 1.031845023636924, 'beta': 0.7943266791583863}. 
[I 2022-11-24 19:46:31,207] Trial 170 finished with values: [0.5508226438569181, 0.5920178999435626] and parameters: {'alpha': 0.001987918130223915, 'beta': 0.1860892412522232}. 
[I 2022-11-24 19:46:33,060] Trial 171 finished with values: [0.25400131032778944, 0.6721077238943354] and parameters: {'alpha': 3.2959408900415093, 'beta': 2.7485638189780044}. 
[I 2022-11-24 19:46:36,900] Trial 172 finished with values: [0.25355590419976537, 0.6743580183064412] and parameters: {'alpha': 0.8396895422315906, 'beta': 0.33592638551938514}. 
[I 2022-11-24 19:46:49,498] Trial 173 finished with values: [0.5695645474355809, 0.5897794120015493] and parameters: {'alpha': 0.007965726529000157, 'beta': 1.028348156175332}. 
[I 2022-11-24 19:47:04,673] Trial 174 finished with values: [0.4047587083432936, 0.6161218382425742] and parameters: {'alpha': 0.006584031129520127, 'beta': 0.12292271244823506}. 
[I 2022-11-24 19:47:09,264] Trial 175 finished with values: [0.26346193784382516, 0.6609417758167534] and parameters: {'alpha': 1.0997069204989047, 'beta': 4.513699824694115}. 
[I 2022-11-24 19:47:23,329] Trial 176 finished with values: [0.34833066586900835, 0.6548607144669061] and parameters: {'alpha': 9.565280873839193, 'beta': 2.112916027168073}. 
[I 2022-11-24 19:47:33,745] Trial 177 finished with values: [0.5435650805685439, 0.5927299677828475] and parameters: {'alpha': 0.002340639743141375, 'beta': 0.22212492579410245}. 
[I 2022-11-24 19:47:37,763] Trial 178 finished with values: [0.25574600177171547, 0.6696334625244458] and parameters: {'alpha': 1.031845023636924, 'beta': 1.331902318296596}. 
[I 2022-11-24 19:47:39,881] Trial 179 finished with values: [0.2555527677264694, 0.669014856393289] and parameters: {'alpha': 1.7238555049512394, 'beta': 2.404934704510003}. 
[I 2022-11-24 19:47:42,463] Trial 180 finished with values: [0.2532077482833999, 0.6743897457227731] and parameters: {'alpha': 3.2959408900415093, 'beta': 0.9599291304678556}. 
[I 2022-11-24 19:47:44,800] Trial 181 finished with values: [0.2543736786912215, 0.6711593054054892] and parameters: {'alpha': 3.817013786656887, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:47:54,832] Trial 182 finished with values: [0.29172135525656323, 0.6450159217640601] and parameters: {'alpha': 0.030217801389605774, 'beta': 0.22212492579410245}. 
[I 2022-11-24 19:47:57,568] Trial 183 finished with values: [0.253402347442459, 0.6740863879169461] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:48:02,073] Trial 184 finished with values: [0.2536446915255243, 0.6746669097771136] and parameters: {'alpha': 0.7350074010068149, 'beta': 0.3934063515381077}. 
[I 2022-11-24 19:48:09,804] Trial 185 finished with values: [0.4808465120125994, 0.6028948540123176] and parameters: {'alpha': 0.05026669535265729, 'beta': 2.1544696799667884}. 
[I 2022-11-24 19:48:12,280] Trial 186 finished with values: [0.25316675646152237, 0.6738509865313119] and parameters: {'alpha': 4.073648303930675, 'beta': 0.8420730776322725}. 
[I 2022-11-24 19:48:27,190] Trial 187 finished with values: [0.2977588347256432, 0.6427271710387229] and parameters: {'alpha': 0.023789455028917064, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:48:31,597] Trial 188 finished with values: [0.25336848183758887, 0.6739914330957659] and parameters: {'alpha': 1.0817172340574543, 'beta': 0.1570187404492478}. 
[I 2022-11-24 19:48:43,631] Trial 189 finished with values: [0.6167973214725145, 0.584952158964469] and parameters: {'alpha': 0.0012623914361294844, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:48:51,717] Trial 190 finished with values: [0.25552251892827016, 0.6697490032710226] and parameters: {'alpha': 1.049537885636239, 'beta': 1.2993552860936706}. 
[I 2022-11-24 19:48:57,633] Trial 191 finished with values: [0.2540692293806777, 0.6722205441592672] and parameters: {'alpha': 4.194144096183795, 'beta': 0.180298201993341}. 
[I 2022-11-24 19:49:17,922] Trial 192 finished with values: [0.255086350977498, 0.6720844780523099] and parameters: {'alpha': 4.992409469602199, 'beta': 0.10423124315975506}. 
[I 2022-11-24 19:49:34,005] Trial 193 finished with values: [0.3751505804533021, 0.6222347481387858] and parameters: {'alpha': 0.029362736276719453, 'beta': 0.7006088199240066}. 
[I 2022-11-24 19:49:37,648] Trial 194 finished with values: [0.2578423357612964, 0.6667975587908135] and parameters: {'alpha': 1.6330587434716772, 'beta': 4.994426452253352}. 
[I 2022-11-24 19:49:41,392] Trial 195 finished with values: [0.253402347442459, 0.6740863879169461] and parameters: {'alpha': 1.4297988383399018, 'beta': 0.3797462196731326}. 
[I 2022-11-24 19:49:45,226] Trial 196 finished with values: [0.253372062770297, 0.6740438861078382] and parameters: {'alpha': 1.0813357629945717, 'beta': 0.16514878663111274}. 
[I 2022-11-24 19:49:53,336] Trial 197 finished with values: [0.25397951978801425, 0.6736002164638175] and parameters: {'alpha': 0.3025430263784877, 'beta': 0.19168335927960659}. 
[I 2022-11-24 19:50:12,127] Trial 198 finished with values: [0.25578270748137205, 0.6695485565518682] and parameters: {'alpha': 0.3923368177270318, 'beta': 0.7006088199240066}. 
[I 2022-11-24 19:50:25,297] Trial 199 finished with values: [0.6340347402257339, 0.5842325390384728] and parameters: {'alpha': 0.0029352567165301818, 'beta': 1.028348156175332}. 

С помощью optuna.visualization.plot_pareto_front визуализируйте результаты сессии. В разных ячейках используйте разные значения аргумента include_dominated_trials. Используйте зум для выделения наглядной зоны, если необходимо. Подпишите ваши objectives с помощью аргумента target_names.

optuna.visualization.plot_pareto_front(multistudy, target_names=['loss', 'score']).show()

Что вы можете сказать об увиденном?

Можем сказать, что оптимум по лоссу и скору достигаются в одних и тех же параметрах, судя по графику.

Ура! А теперь...

Бонусная часть. Постигая ASHA (7 баллов)

В бонусной части забудем датасет и линейные модели! Вам предстоит наглядно убедиться и разобраться в том, как работает optuna.pruners.SuccessiveHalvingPruner, он же ASHA. Важно понимать, как устроены optuna.pruners - правильное их использование заметно сократит время ожидания и может улучшить качество.

В вашем распоряжении семинар, документация и исходный код классов в optuna.

0

Начнем с простого - будем использовать предложенный простенький objective, чтобы убедиться, что все trials успешно доходят до конца.

Все указанные параметры не изменяйте в дальнейшем, если этого не просят в задании.

def objective_0(trial):
    for i in range(31):
        trial.report(val=trial.number, step=i)
        if trial.should_prune():
            raise optuna.TrialPruned()
    return 0

pruner = optuna.pruners.SuccessiveHalvingPruner(min_resource=2, reduction_factor=2,
                                                bootstrap_count=0, min_early_stopping_rate=0)
study = optuna.create_study(direction='maximize', pruner=pruner)

study.optimize(objective_0, n_trials=16, n_jobs=4)

Давайте визуализируем наш study. Напишите функцию plot_study_info, отрисовывающую жизненный путь всех trials. Используйте данный ниже шаблон. Под визулизацией будем понимать нечто похожее на картинки с семинара:

• ось Х - step, ось Y - trial.number.

• каждый trial - горизонтальная синяя прямая от -1 до trial.last_step.

• если trial дошел до конца, на конце прямой поставьте зеленый кружок, если обрезался - красный крестик [plt.scatter(..., marker=...)].

• синяя вертикальная прямая на отметке step = 0 - "день рождения" trial.

• черными вертикальными прямыми расставьте rungs. Воспользуйтесь исходным кодом SuccessiveHalvingPruner для выяснения всех обстоятельств.

• зелеными вертикальными линиями отметьте те steps, на которых делается trial.report. Сделайте так, чтобы эти линии были видны поверх линий, обозначающих rungs, если такие случаи будут иметь место.

• что еще хотите от себя! Учтите, что trials после сессии оптимизации являются FrozenTrials.

Пожалуйста, уделите должное внимание этой функции и отладьте ее. Убедитесь, что все хорошо видно, что все адекватного размера. Вы будете ее часто использовать далее.

def plot_study_info(study, min_resource, max_resource, gamma, early_stopping=0, *your_args, **your_kwargs):
    # your code here
    pass

Визуализируйте первую сессию, используя вашу фукнцию. Что в данном случае такое max_resource?

# your code here

Почему все trials дошли до конца?

1

Напишите новый objective - попробуйте порепортить случайные значения, устроив беспорядок. Создайте новый study и запустите сессию оптимизации с теми же параметрами. Визуализируйте процесс и убедитесь, что все правильно. Далее, эту цепочку будем называть "запустите и визуализируйте".

# your code here

Что-нибудь интересное на картинке?

2

Теперь напишите еще один objective - все должны дойти до конца, но теперь не по порядку, то есть i-й по скорости trial не должен иметь trial.number = i - 1. Запустите и визуализируйте.

# your code here

Объясните, как вы добились того, что trials заканчивают не по порядку.

3

Оставьте прошлый objective и положите bootstrap_count=2. Запустите и визуализируйте.

# your code here

Как в итоге работает этот аргумент?

4

Напишите новый objective, чтобы trial.report не всегда приходился на step = rung. Запустите и визуализируйте.

# your code here

Объясните увиденное

5

Используя предыдущий objective, запустите сессии с аргументом прунера min_early_stopping = 0, 1, 2, 3.

Визуализируйте их друг под другом. Если к этому моменту вы убедились, что ваша рисовалка работает правильно, используйте optuna.logging.set_verbosity, чтобы скрыть вывод о ходе сессии.

# your code here

Объясните, за что отвечает этот аргумент и при чем здесь early_stopping.

6

Мы достигли достаточного уровня мастерства чтобы визуализировать optuna.pruners.HyperbandPruner! Hyperband создает несколько brackets, отправляя тот или иной trial в тот или иной bracket по хэшу. Подробнее - см. семинар, описание или исходный код.

Используя objective на ваш вкус, создайте новый study с HyperbandPruner. Подберите max_resource так, чтобы получилось 4 брэкета. На что еще влияет max_resource в HyperbandPruner?

Запустите и визуализируйте брэкеты друг под другом. Если нужно, напишите новую фукнцию для отрисовки брэкетов по study, хотя по сути - прошлая функция как раз отрисовывала один брэкет; возможно, можно лишь немного изменить её.

# your code here

Опишите свои наблюдения.

7. Босс!

Отрисуйте слепки одного брэкета (используйте ASHA) в режиме реального времени, используя ask-tell интерфейс вместо study.optimize. Например, вы можете рисовать состояние брэкета (в данном случае, study = bracket) когда появляется каждый второй trial. Используйте time.sleep для того чтобы сделать картинку интереснее. Подумайте, как лучше отрисовывать, чтобы хорошо было видно развитие сюжета. Если нужно, используйте другую функцию для отрисовки.

# your code here

Опишите свои наблюдения.

Еще одно ура! Как впечатления?